2023-11-15 19:53:16,319 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-15 19:53:16,575 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1 2023-11-15 19:53:16,591 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-15 19:53:16,591 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/cluster_60a5767f-3161-dba1-1f98-fab1c37be2d9, deleteOnExit=true 2023-11-15 19:53:16,591 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-15 19:53:16,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/test.cache.data in system properties and HBase conf 2023-11-15 19:53:16,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/hadoop.tmp.dir in system properties and HBase conf 2023-11-15 19:53:16,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/hadoop.log.dir in system properties and HBase conf 2023-11-15 19:53:16,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-15 19:53:16,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-15 19:53:16,594 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-15 19:53:16,717 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-15 19:53:17,119 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-15 19:53:17,125 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-15 19:53:17,125 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-15 19:53:17,126 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-15 19:53:17,126 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-15 19:53:17,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-15 19:53:17,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-15 19:53:17,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-15 19:53:17,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-15 19:53:17,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-15 19:53:17,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/nfs.dump.dir in system properties and HBase conf 2023-11-15 19:53:17,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/java.io.tmpdir in system properties and HBase conf 2023-11-15 19:53:17,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-15 19:53:17,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-15 19:53:17,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-15 19:53:17,772 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-15 19:53:17,777 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-15 19:53:18,072 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-15 19:53:18,249 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-15 19:53:18,275 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-15 19:53:18,316 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-15 19:53:18,349 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/java.io.tmpdir/Jetty_localhost_40913_hdfs____.vpni9j/webapp 2023-11-15 19:53:18,507 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40913 2023-11-15 19:53:18,517 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-15 19:53:18,517 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-15 19:53:19,036 WARN [Listener at localhost/37975] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-15 19:53:19,113 WARN [Listener at localhost/37975] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-15 19:53:19,133 WARN [Listener at localhost/37975] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-15 19:53:19,140 INFO [Listener at localhost/37975] log.Slf4jLog(67): jetty-6.1.26 2023-11-15 19:53:19,145 INFO [Listener at localhost/37975] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/java.io.tmpdir/Jetty_localhost_45185_datanode____.o9hqz0/webapp 2023-11-15 19:53:19,264 INFO [Listener at localhost/37975] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45185 2023-11-15 19:53:19,660 WARN [Listener at localhost/43577] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-15 19:53:20,213 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7d106a5e33b144a: Processing first storage report for DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e from datanode 8ca454cd-60e8-41a1-b415-f9c0c45a98ca 2023-11-15 19:53:20,215 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7d106a5e33b144a: from storage DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e node DatanodeRegistration(127.0.0.1:45649, datanodeUuid=8ca454cd-60e8-41a1-b415-f9c0c45a98ca, infoPort=35867, infoSecurePort=0, ipcPort=43577, storageInfo=lv=-57;cid=testClusterID;nsid=1217130041;c=1700077997855), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-15 19:53:20,215 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7d106a5e33b144a: Processing first storage report for DS-8f300a61-b806-446f-ac0d-9fb9a6c9c66e from datanode 8ca454cd-60e8-41a1-b415-f9c0c45a98ca 2023-11-15 19:53:20,215 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7d106a5e33b144a: from storage DS-8f300a61-b806-446f-ac0d-9fb9a6c9c66e node DatanodeRegistration(127.0.0.1:45649, datanodeUuid=8ca454cd-60e8-41a1-b415-f9c0c45a98ca, infoPort=35867, infoSecurePort=0, ipcPort=43577, storageInfo=lv=-57;cid=testClusterID;nsid=1217130041;c=1700077997855), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-15 19:53:20,304 DEBUG [Listener at localhost/43577] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1 2023-11-15 19:53:20,411 INFO [Listener at localhost/43577] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/cluster_60a5767f-3161-dba1-1f98-fab1c37be2d9/zookeeper_0, clientPort=50885, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/cluster_60a5767f-3161-dba1-1f98-fab1c37be2d9/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/cluster_60a5767f-3161-dba1-1f98-fab1c37be2d9/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-15 19:53:20,425 INFO [Listener at localhost/43577] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50885 2023-11-15 19:53:20,432 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:20,434 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:21,129 INFO [Listener at localhost/43577] util.FSUtils(471): Created version file at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552 with version=8 2023-11-15 19:53:21,129 INFO [Listener at localhost/43577] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/hbase-staging 2023-11-15 19:53:21,430 INFO [Listener at localhost/43577] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-15 19:53:21,887 INFO [Listener at localhost/43577] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-15 19:53:21,919 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-15 19:53:21,920 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-15 19:53:21,920 INFO [Listener at localhost/43577] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-15 19:53:21,920 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-15 19:53:21,920 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-15 19:53:22,099 INFO [Listener at localhost/43577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-15 19:53:22,179 DEBUG [Listener at localhost/43577] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-15 19:53:22,272 INFO [Listener at localhost/43577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38755 2023-11-15 19:53:22,282 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:22,284 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:22,306 INFO [Listener at localhost/43577] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38755 connecting to ZooKeeper ensemble=127.0.0.1:50885 2023-11-15 19:53:22,356 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:387550x0, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-15 19:53:22,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38755-0x101eb4ad0a90000 connected 2023-11-15 19:53:22,399 DEBUG [Listener at localhost/43577] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-15 19:53:22,400 DEBUG [Listener at localhost/43577] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-15 19:53:22,404 DEBUG [Listener at localhost/43577] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-15 19:53:22,412 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38755 2023-11-15 19:53:22,412 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38755 2023-11-15 19:53:22,412 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38755 2023-11-15 19:53:22,413 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38755 2023-11-15 19:53:22,415 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38755 2023-11-15 19:53:22,420 INFO [Listener at localhost/43577] master.HMaster(444): hbase.rootdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552, hbase.cluster.distributed=false 2023-11-15 19:53:22,491 INFO [Listener at localhost/43577] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-15 19:53:22,492 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-15 19:53:22,492 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-15 19:53:22,492 INFO [Listener at localhost/43577] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-15 19:53:22,492 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-15 19:53:22,493 INFO [Listener at localhost/43577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-15 19:53:22,498 INFO [Listener at localhost/43577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-15 19:53:22,501 INFO [Listener at localhost/43577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42249 2023-11-15 19:53:22,503 INFO [Listener at localhost/43577] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-15 19:53:22,510 DEBUG [Listener at localhost/43577] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-15 19:53:22,511 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:22,514 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:22,516 INFO [Listener at localhost/43577] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42249 connecting to ZooKeeper ensemble=127.0.0.1:50885 2023-11-15 19:53:22,520 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:422490x0, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-15 19:53:22,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42249-0x101eb4ad0a90001 connected 2023-11-15 19:53:22,521 DEBUG [Listener at localhost/43577] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-15 19:53:22,522 DEBUG [Listener at localhost/43577] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-15 19:53:22,523 DEBUG [Listener at localhost/43577] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-15 19:53:22,525 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42249 2023-11-15 19:53:22,525 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42249 2023-11-15 19:53:22,525 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42249 2023-11-15 19:53:22,526 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42249 2023-11-15 19:53:22,526 DEBUG [Listener at localhost/43577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42249 2023-11-15 19:53:22,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:22,537 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-15 19:53:22,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:22,558 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-15 19:53:22,558 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-15 19:53:22,558 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:22,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-15 19:53:22,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38755,1700078001267 from backup master directory 2023-11-15 19:53:22,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-15 19:53:22,564 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:22,564 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-15 19:53:22,565 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-15 19:53:22,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:22,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-15 19:53:22,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-15 19:53:22,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/hbase.id with ID: a7c984e1-150a-4ac6-a883-41626bd2898f 2023-11-15 19:53:22,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:22,708 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:22,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4d96b69b to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:53:22,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e2fe24d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:53:22,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-15 19:53:22,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-15 19:53:22,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-15 19:53:22,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-15 19:53:22,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-15 19:53:22,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-15 19:53:22,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-15 19:53:22,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store-tmp 2023-11-15 19:53:22,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:22,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-15 19:53:22,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:53:22,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:53:22,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-15 19:53:22,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:53:22,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:53:22,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-15 19:53:22,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/WALs/jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:22,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38755%2C1700078001267, suffix=, logDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/WALs/jenkins-hbase4.apache.org,38755,1700078001267, archiveDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/oldWALs, maxLogs=10 2023-11-15 19:53:22,978 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45649,DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e,DISK] 2023-11-15 19:53:22,986 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-15 19:53:23,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/WALs/jenkins-hbase4.apache.org,38755,1700078001267/jenkins-hbase4.apache.org%2C38755%2C1700078001267.1700078002928 2023-11-15 19:53:23,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45649,DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e,DISK]] 2023-11-15 19:53:23,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:53:23,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:23,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-15 19:53:23,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-15 19:53:23,122 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-15 19:53:23,129 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-15 19:53:23,159 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-15 19:53:23,172 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:23,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-15 19:53:23,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-15 19:53:23,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-15 19:53:23,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:53:23,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63079831, jitterRate=-0.060037270188331604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:53:23,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-15 19:53:23,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-15 19:53:23,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-15 19:53:23,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-15 19:53:23,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-15 19:53:23,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 0 msec 2023-11-15 19:53:23,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 32 msec 2023-11-15 19:53:23,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-15 19:53:23,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-15 19:53:23,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-15 19:53:23,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-15 19:53:23,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-15 19:53:23,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-15 19:53:23,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-15 19:53:23,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-15 19:53:23,341 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:23,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-15 19:53:23,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-15 19:53:23,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-15 19:53:23,362 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-15 19:53:23,362 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-15 19:53:23,362 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:23,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38755,1700078001267, sessionid=0x101eb4ad0a90000, setting cluster-up flag (Was=false) 2023-11-15 19:53:23,386 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:23,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-15 19:53:23,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:23,406 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:23,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-15 19:53:23,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:23,418 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp 2023-11-15 19:53:23,430 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(951): ClusterId : a7c984e1-150a-4ac6-a883-41626bd2898f 2023-11-15 19:53:23,436 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-15 19:53:23,446 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-15 19:53:23,446 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-15 19:53:23,450 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-15 19:53:23,452 DEBUG [RS:0;jenkins-hbase4:42249] zookeeper.ReadOnlyZKClient(139): Connect 0x778b05eb to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:53:23,463 DEBUG [RS:0;jenkins-hbase4:42249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@794cf56a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:53:23,464 DEBUG [RS:0;jenkins-hbase4:42249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d736e9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-15 19:53:23,500 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42249 2023-11-15 19:53:23,505 INFO [RS:0;jenkins-hbase4:42249] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-15 19:53:23,505 INFO [RS:0;jenkins-hbase4:42249] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-15 19:53:23,505 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1022): About to register with Master. 2023-11-15 19:53:23,509 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38755,1700078001267 with isa=jenkins-hbase4.apache.org/172.31.14.131:42249, startcode=1700078002491 2023-11-15 19:53:23,531 DEBUG [RS:0;jenkins-hbase4:42249] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-15 19:53:23,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-15 19:53:23,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-15 19:53:23,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-15 19:53:23,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-15 19:53:23,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-15 19:53:23,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-15 19:53:23,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-15 19:53:23,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700078033572 2023-11-15 19:53:23,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-15 19:53:23,579 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-15 19:53:23,579 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-15 19:53:23,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-15 19:53:23,586 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-15 19:53:23,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-15 19:53:23,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-15 19:53:23,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-15 19:53:23,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-15 19:53:23,598 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55395, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-15 19:53:23,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-15 19:53:23,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-15 19:53:23,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-15 19:53:23,611 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38755] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-11-15 19:53:23,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-15 19:53:23,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-15 19:53:23,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700078003631,5,FailOnTimeoutGroup] 2023-11-15 19:53:23,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700078003631,5,FailOnTimeoutGroup] 2023-11-15 19:53:23,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-15 19:53:23,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,651 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(2830): Master is not running yet 2023-11-15 19:53:23,651 WARN [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-11-15 19:53:23,753 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38755,1700078001267 with isa=jenkins-hbase4.apache.org/172.31.14.131:42249, startcode=1700078002491 2023-11-15 19:53:23,759 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38755] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:23,765 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552 2023-11-15 19:53:23,765 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37975 2023-11-15 19:53:23,765 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-15 19:53:23,773 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-15 19:53:23,773 DEBUG [RS:0;jenkins-hbase4:42249] zookeeper.ZKUtil(162): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:23,774 WARN [RS:0;jenkins-hbase4:42249] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-15 19:53:23,774 INFO [RS:0;jenkins-hbase4:42249] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-15 19:53:23,775 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/WALs/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:23,775 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42249,1700078002491] 2023-11-15 19:53:23,784 DEBUG [RS:0;jenkins-hbase4:42249] zookeeper.ZKUtil(162): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:23,795 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-15 19:53:23,803 INFO [RS:0;jenkins-hbase4:42249] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-15 19:53:23,821 INFO [RS:0;jenkins-hbase4:42249] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-15 19:53:23,824 INFO [RS:0;jenkins-hbase4:42249] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:53:23,825 INFO [RS:0;jenkins-hbase4:42249] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,826 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-15 19:53:23,833 INFO [RS:0;jenkins-hbase4:42249] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,833 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,834 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,834 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,834 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,834 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,834 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-15 19:53:23,834 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,835 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,835 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,835 DEBUG [RS:0;jenkins-hbase4:42249] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-15 19:53:23,837 INFO [RS:0;jenkins-hbase4:42249] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,837 INFO [RS:0;jenkins-hbase4:42249] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,837 INFO [RS:0;jenkins-hbase4:42249] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,855 INFO [RS:0;jenkins-hbase4:42249] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-15 19:53:23,858 INFO [RS:0;jenkins-hbase4:42249] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42249,1700078002491-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:23,875 INFO [RS:0;jenkins-hbase4:42249] regionserver.Replication(203): jenkins-hbase4.apache.org,42249,1700078002491 started 2023-11-15 19:53:23,875 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42249,1700078002491, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42249, sessionid=0x101eb4ad0a90001 2023-11-15 19:53:23,875 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-15 19:53:23,875 DEBUG [RS:0;jenkins-hbase4:42249] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:23,875 DEBUG [RS:0;jenkins-hbase4:42249] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42249,1700078002491' 2023-11-15 19:53:23,875 DEBUG [RS:0;jenkins-hbase4:42249] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:23,876 DEBUG [RS:0;jenkins-hbase4:42249] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:23,877 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-15 19:53:23,877 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-15 19:53:23,877 DEBUG [RS:0;jenkins-hbase4:42249] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:23,877 DEBUG [RS:0;jenkins-hbase4:42249] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42249,1700078002491' 2023-11-15 19:53:23,877 DEBUG [RS:0;jenkins-hbase4:42249] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-15 19:53:23,878 DEBUG [RS:0;jenkins-hbase4:42249] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-15 19:53:23,879 DEBUG [RS:0;jenkins-hbase4:42249] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-15 19:53:23,879 INFO [RS:0;jenkins-hbase4:42249] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-15 19:53:23,879 INFO [RS:0;jenkins-hbase4:42249] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-15 19:53:23,991 INFO [RS:0;jenkins-hbase4:42249] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42249%2C1700078002491, suffix=, logDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/WALs/jenkins-hbase4.apache.org,42249,1700078002491, archiveDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/oldWALs, maxLogs=32 2023-11-15 19:53:24,024 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45649,DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e,DISK] 2023-11-15 19:53:24,029 INFO [RS:0;jenkins-hbase4:42249] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/WALs/jenkins-hbase4.apache.org,42249,1700078002491/jenkins-hbase4.apache.org%2C42249%2C1700078002491.1700078003996 2023-11-15 19:53:24,029 DEBUG [RS:0;jenkins-hbase4:42249] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45649,DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e,DISK]] 2023-11-15 19:53:24,039 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-15 19:53:24,040 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-15 19:53:24,040 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552 2023-11-15 19:53:24,464 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:24,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-15 19:53:24,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/info 2023-11-15 19:53:24,473 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-15 19:53:24,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:24,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-15 19:53:24,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/rep_barrier 2023-11-15 19:53:24,478 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-15 19:53:24,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:24,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-15 19:53:24,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/table 2023-11-15 19:53:24,483 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-15 19:53:24,484 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:24,486 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740 2023-11-15 19:53:24,487 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740 2023-11-15 19:53:24,491 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-15 19:53:24,492 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-15 19:53:24,496 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:53:24,497 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60355202, jitterRate=-0.10063740611076355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-15 19:53:24,498 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-15 19:53:24,498 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-15 19:53:24,498 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-15 19:53:24,498 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-15 19:53:24,498 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-15 19:53:24,498 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-15 19:53:24,499 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-15 19:53:24,500 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-15 19:53:24,506 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-15 19:53:24,506 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-15 19:53:24,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-15 19:53:24,530 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-15 19:53:24,533 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-15 19:53:24,685 DEBUG [jenkins-hbase4:38755] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-15 19:53:24,688 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42249,1700078002491, state=OPENING 2023-11-15 19:53:24,696 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-15 19:53:24,698 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:24,699 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-15 19:53:24,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:53:24,890 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:24,892 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-15 19:53:24,896 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-15 19:53:24,907 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-15 19:53:24,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-15 19:53:24,911 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42249%2C1700078002491.meta, suffix=.meta, logDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/WALs/jenkins-hbase4.apache.org,42249,1700078002491, archiveDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/oldWALs, maxLogs=32 2023-11-15 19:53:24,930 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45649,DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e,DISK] 2023-11-15 19:53:24,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/WALs/jenkins-hbase4.apache.org,42249,1700078002491/jenkins-hbase4.apache.org%2C42249%2C1700078002491.meta.1700078004913.meta 2023-11-15 19:53:24,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45649,DS-4e7e05bd-6179-4993-a7d8-60caf7951e3e,DISK]] 2023-11-15 19:53:24,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:53:24,941 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-15 19:53:24,963 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-15 19:53:24,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-15 19:53:24,974 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-15 19:53:24,974 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:24,974 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-15 19:53:24,975 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-15 19:53:24,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-15 19:53:24,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/info 2023-11-15 19:53:24,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/info 2023-11-15 19:53:24,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-15 19:53:24,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:24,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-15 19:53:24,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/rep_barrier 2023-11-15 19:53:24,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/rep_barrier 2023-11-15 19:53:24,985 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-15 19:53:24,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:24,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-15 19:53:24,987 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/table 2023-11-15 19:53:24,988 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/table 2023-11-15 19:53:24,988 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-15 19:53:24,989 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:24,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740 2023-11-15 19:53:24,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740 2023-11-15 19:53:24,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-15 19:53:25,001 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-15 19:53:25,002 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64782968, jitterRate=-0.03465855121612549}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-15 19:53:25,002 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-15 19:53:25,012 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700078004882 2023-11-15 19:53:25,030 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-15 19:53:25,031 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-15 19:53:25,031 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42249,1700078002491, state=OPEN 2023-11-15 19:53:25,038 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-15 19:53:25,038 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-15 19:53:25,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-15 19:53:25,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42249,1700078002491 in 336 msec 2023-11-15 19:53:25,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-15 19:53:25,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 529 msec 2023-11-15 19:53:25,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5660 sec 2023-11-15 19:53:25,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700078005052, completionTime=-1 2023-11-15 19:53:25,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-15 19:53:25,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-15 19:53:25,119 DEBUG [hconnection-0x38aea997-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:53:25,122 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:53:25,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-15 19:53:25,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700078065139 2023-11-15 19:53:25,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700078125139 2023-11-15 19:53:25,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 86 msec 2023-11-15 19:53:25,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38755,1700078001267-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:25,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38755,1700078001267-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:25,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38755,1700078001267-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:25,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38755, period=300000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:25,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-15 19:53:25,172 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-15 19:53:25,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-15 19:53:25,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-15 19:53:25,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-15 19:53:25,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:53:25,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:53:25,215 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:25,218 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca empty. 2023-11-15 19:53:25,219 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:25,219 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-15 19:53:25,239 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-15 19:53:25,241 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a1e2b054e120c42d1c3254e5bf778fca, NAME => 'hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:53:25,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:25,652 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a1e2b054e120c42d1c3254e5bf778fca, disabling compactions & flushes 2023-11-15 19:53:25,653 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:53:25,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:53:25,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. after waiting 0 ms 2023-11-15 19:53:25,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:53:25,653 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:53:25,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a1e2b054e120c42d1c3254e5bf778fca: 2023-11-15 19:53:25,658 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:53:25,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700078005661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078005661"}]},"ts":"1700078005661"} 2023-11-15 19:53:25,699 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:53:25,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:53:25,707 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078005702"}]},"ts":"1700078005702"} 2023-11-15 19:53:25,710 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-15 19:53:25,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a1e2b054e120c42d1c3254e5bf778fca, ASSIGN}] 2023-11-15 19:53:25,721 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a1e2b054e120c42d1c3254e5bf778fca, ASSIGN 2023-11-15 19:53:25,723 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a1e2b054e120c42d1c3254e5bf778fca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:53:25,874 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a1e2b054e120c42d1c3254e5bf778fca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:25,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700078005873"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078005873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078005873"}]},"ts":"1700078005873"} 2023-11-15 19:53:25,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a1e2b054e120c42d1c3254e5bf778fca, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:53:26,032 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:26,038 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:53:26,038 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1e2b054e120c42d1c3254e5bf778fca, NAME => 'hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:53:26,039 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:26,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:26,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:26,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:26,042 INFO [StoreOpener-a1e2b054e120c42d1c3254e5bf778fca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:26,044 DEBUG [StoreOpener-a1e2b054e120c42d1c3254e5bf778fca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/info 2023-11-15 19:53:26,044 DEBUG [StoreOpener-a1e2b054e120c42d1c3254e5bf778fca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/info 2023-11-15 19:53:26,044 INFO [StoreOpener-a1e2b054e120c42d1c3254e5bf778fca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1e2b054e120c42d1c3254e5bf778fca columnFamilyName info 2023-11-15 19:53:26,045 INFO [StoreOpener-a1e2b054e120c42d1c3254e5bf778fca-1] regionserver.HStore(310): Store=a1e2b054e120c42d1c3254e5bf778fca/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:26,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:26,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:26,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:53:26,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:53:26,055 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1e2b054e120c42d1c3254e5bf778fca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61320249, jitterRate=-0.08625708520412445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:53:26,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1e2b054e120c42d1c3254e5bf778fca: 2023-11-15 19:53:26,057 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca., pid=6, masterSystemTime=1700078006032 2023-11-15 19:53:26,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:53:26,061 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:53:26,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a1e2b054e120c42d1c3254e5bf778fca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:26,063 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700078006062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078006062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078006062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078006062"}]},"ts":"1700078006062"} 2023-11-15 19:53:26,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-15 19:53:26,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a1e2b054e120c42d1c3254e5bf778fca, server=jenkins-hbase4.apache.org,42249,1700078002491 in 187 msec 2023-11-15 19:53:26,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-15 19:53:26,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a1e2b054e120c42d1c3254e5bf778fca, ASSIGN in 350 msec 2023-11-15 19:53:26,074 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:53:26,074 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078006074"}]},"ts":"1700078006074"} 2023-11-15 19:53:26,077 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-15 19:53:26,081 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:53:26,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 901 msec 2023-11-15 19:53:26,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-15 19:53:26,093 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-15 19:53:26,093 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:53:26,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-15 19:53:26,148 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-15 19:53:26,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-11-15 19:53:26,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-15 19:53:26,175 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-15 19:53:26,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-11-15 19:53:26,190 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-15 19:53:26,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-15 19:53:26,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.628sec 2023-11-15 19:53:26,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-15 19:53:26,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-15 19:53:26,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-15 19:53:26,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38755,1700078001267-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-15 19:53:26,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38755,1700078001267-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-15 19:53:26,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-15 19:53:26,237 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(139): Connect 0x77fd41f4 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:53:26,247 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ed63e4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:53:26,263 DEBUG [hconnection-0x40c4f23-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:53:26,278 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:53:26,288 INFO [Listener at localhost/43577] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:53:26,290 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(139): Connect 0x0a11c17b to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:53:26,297 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31f4d39e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:53:26,297 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:53:26,339 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=171, AvailableMemoryMB=1649 2023-11-15 19:53:26,350 DEBUG [Listener at localhost/43577] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:53:26,354 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:53:26,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-15 19:53:26,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:26,371 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:53:26,373 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:53:26,376 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-15 19:53:26,378 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74 empty. 2023-11-15 19:53:26,380 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,380 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-15 19:53:26,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-15 19:53:26,398 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-15 19:53:26,404 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => e7de5c4100e506844c83d967f1832b74, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:53:26,416 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:26,416 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing e7de5c4100e506844c83d967f1832b74, disabling compactions & flushes 2023-11-15 19:53:26,416 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:26,416 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:26,416 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. after waiting 0 ms 2023-11-15 19:53:26,416 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:26,416 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:26,416 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:26,421 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:53:26,422 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700078006422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078006422"}]},"ts":"1700078006422"} 2023-11-15 19:53:26,425 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:53:26,427 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:53:26,427 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078006427"}]},"ts":"1700078006427"} 2023-11-15 19:53:26,429 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-15 19:53:26,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, ASSIGN}] 2023-11-15 19:53:26,442 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, ASSIGN 2023-11-15 19:53:26,444 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:53:26,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-15 19:53:26,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e7de5c4100e506844c83d967f1832b74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:26,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700078006595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078006595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078006595"}]},"ts":"1700078006595"} 2023-11-15 19:53:26,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e7de5c4100e506844c83d967f1832b74, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:53:26,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-15 19:53:26,752 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:26,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:26,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7de5c4100e506844c83d967f1832b74, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:53:26,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:26,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,763 INFO [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,765 DEBUG [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:26,765 DEBUG [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:26,768 INFO [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7de5c4100e506844c83d967f1832b74 columnFamilyName family1 2023-11-15 19:53:26,772 INFO [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] regionserver.HStore(310): Store=e7de5c4100e506844c83d967f1832b74/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:26,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:26,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:53:26,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7de5c4100e506844c83d967f1832b74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61827813, jitterRate=-0.07869379222393036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:53:26,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:26,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74., pid=11, masterSystemTime=1700078006752 2023-11-15 19:53:26,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:26,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:26,808 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e7de5c4100e506844c83d967f1832b74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:26,809 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700078006808"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078006808"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078006808"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078006808"}]},"ts":"1700078006808"} 2023-11-15 19:53:26,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-15 19:53:26,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e7de5c4100e506844c83d967f1832b74, server=jenkins-hbase4.apache.org,42249,1700078002491 in 216 msec 2023-11-15 19:53:26,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-15 19:53:26,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, ASSIGN in 378 msec 2023-11-15 19:53:26,823 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:53:26,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078006823"}]},"ts":"1700078006823"} 2023-11-15 19:53:26,827 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-15 19:53:26,830 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:53:26,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 463 msec 2023-11-15 19:53:27,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-15 19:53:27,001 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-15 19:53:27,020 DEBUG [hconnection-0x2c9fcfea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:53:27,024 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:53:27,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:27,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,188 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:27,188 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:27,189 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:27,189 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:27,190 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,190 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,191 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:27,191 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:27,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:27,192 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,192 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,193 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,195 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:27,195 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:27,196 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:27,197 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:27,197 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:27,197 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:27,198 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:27,199 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-15 19:53:27,754 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b645987217ed4020a8f56bffbc70d7d1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b645987217ed4020a8f56bffbc70d7d1 2023-11-15 19:53:27,774 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/2bf2444d0f354fdcbf894999f7f75652 2023-11-15 19:53:27,787 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/2bf2444d0f354fdcbf894999f7f75652 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/2bf2444d0f354fdcbf894999f7f75652 2023-11-15 19:53:27,796 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/2bf2444d0f354fdcbf894999f7f75652, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-15 19:53:27,800 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 601ms, sequenceid=5, compaction requested=false 2023-11-15 19:53:27,801 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:27,805 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:27,805 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:27,809 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,809 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:27,809 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,809 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:27,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:27,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a839566[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:27,812 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:27,812 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,815 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,815 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:27,815 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:27,815 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:27,815 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,815 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:27,818 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:27,819 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:27,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:27,824 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:27,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:27,824 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:27,825 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:27,825 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,825 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:27,828 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,828 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,828 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:27,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:27,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:27,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:27,829 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:27,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,831 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:27,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:27,844 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:27,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:27,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:27,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:27,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:27,846 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:27,847 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:27,947 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:27,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:27,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:27,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:27,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,965 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:27,965 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:27,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:27,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:27,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,973 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:27,973 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:27,974 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,974 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:27,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,975 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:27,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:27,976 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:27,976 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:27,976 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:27,976 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:27,976 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:27,976 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:27,976 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:27,977 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-15 19:53:28,412 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282541716b49404ff49aefa32c76048dd7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511282541716b49404ff49aefa32c76048dd7 2023-11-15 19:53:28,440 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/9f517d3b26d14780b59808850dd27176 2023-11-15 19:53:28,451 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/9f517d3b26d14780b59808850dd27176 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/9f517d3b26d14780b59808850dd27176 2023-11-15 19:53:28,461 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/9f517d3b26d14780b59808850dd27176, entries=1, sequenceid=9, filesize=5.0 K 2023-11-15 19:53:28,462 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 485ms, sequenceid=9, compaction requested=false 2023-11-15 19:53:28,462 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:28,463 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:28,466 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,467 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,467 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:28,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:28,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b255a8[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:28,470 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:28,470 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,472 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,472 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:28,472 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:28,472 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:28,472 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,472 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:28,475 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:28,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:28,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:28,480 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:28,480 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:28,480 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:28,480 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,480 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:28,483 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,483 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:28,483 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:28,485 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,487 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,493 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,493 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:28,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:28,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:28,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:28,494 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:28,495 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:28,595 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:28,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:28,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:28,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:28,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,606 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:28,606 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:28,607 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:28,607 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:28,607 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,608 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,609 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:28,609 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:28,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:28,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,611 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:28,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:28,611 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:28,612 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:28,612 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:28,612 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:28,612 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:28,612 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:28,612 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:28,612 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:29,038 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120141f48c5a235c494b8acf2a11199346ef to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120141f48c5a235c494b8acf2a11199346ef 2023-11-15 19:53:29,451 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/a910329414cb420eb93994128f62c807 2023-11-15 19:53:29,462 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/a910329414cb420eb93994128f62c807 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a910329414cb420eb93994128f62c807 2023-11-15 19:53:29,478 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a910329414cb420eb93994128f62c807, entries=1, sequenceid=13, filesize=5.0 K 2023-11-15 19:53:29,480 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 868ms, sequenceid=13, compaction requested=true 2023-11-15 19:53:29,480 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:29,480 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:29,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,484 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:29,485 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,485 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f008681[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:29,492 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:29,492 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,495 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,495 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:29,497 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,497 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:29,499 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:29,499 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,499 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:29,500 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:29,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:29,506 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:29,506 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:29,507 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:29,507 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,507 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:29,521 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,521 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,521 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:29,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:29,523 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:29,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,530 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,539 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,539 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,539 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:29,539 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:29,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:29,540 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,540 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,540 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,540 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:29,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-15 19:53:29,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:29,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:29,540 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,540 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:29,541 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:29,541 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:29,642 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:29,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:29,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:29,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:29,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,656 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:29,656 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:29,656 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:29,656 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:29,657 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,657 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:29,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:29,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:29,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:29,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:29,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:29,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,663 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:29,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:29,663 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:29,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:29,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:29,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:29,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:29,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:29,799 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-15 19:53:29,801 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-15 19:53:30,094 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c071c44af135441b8d250bb1bd339f3a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c071c44af135441b8d250bb1bd339f3a 2023-11-15 19:53:30,502 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:53:30,513 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/a3b623702f3b42ee8474d0c320d19c73 2023-11-15 19:53:30,524 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/a3b623702f3b42ee8474d0c320d19c73 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a3b623702f3b42ee8474d0c320d19c73 2023-11-15 19:53:30,534 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a3b623702f3b42ee8474d0c320d19c73, entries=1, sequenceid=17, filesize=5.0 K 2023-11-15 19:53:30,537 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 872ms, sequenceid=17, compaction requested=true 2023-11-15 19:53:30,537 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:30,538 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:30,538 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:30,539 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:30,539 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,539 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:30,539 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:30,541 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:30,542 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,542 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:30,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:30,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26d6827a[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:30,544 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:30,544 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,546 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,547 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:30,547 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:30,547 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:30,547 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,547 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:30,550 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,550 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:30,550 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:30,551 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:30,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:30,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:30,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:30,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:30,555 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:30,555 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:30,555 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:30,555 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,555 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:30,561 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,561 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,561 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:30,562 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,565 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:30,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:30,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:30,573 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,573 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,573 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,573 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,573 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:30,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:30,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:30,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:30,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-15 19:53:30,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:30,574 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:30,575 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:30,675 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:30,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:30,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:30,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,689 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:30,689 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:30,689 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:30,689 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:30,690 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,690 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,692 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:30,692 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:30,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:30,693 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:30,693 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:30,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:30,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,694 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,694 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:30,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:30,694 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:30,694 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:30,695 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:30,695 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:30,695 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:30,695 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:30,695 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:30,695 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:31,119 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d6d40e1795554aff83873e226bba24c1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d6d40e1795554aff83873e226bba24c1 2023-11-15 19:53:31,426 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-15 19:53:31,427 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-15 19:53:31,532 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/51f098d696e14431a10decb7b74afb84 2023-11-15 19:53:31,542 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/51f098d696e14431a10decb7b74afb84 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/51f098d696e14431a10decb7b74afb84 2023-11-15 19:53:31,550 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/51f098d696e14431a10decb7b74afb84, entries=1, sequenceid=21, filesize=5.0 K 2023-11-15 19:53:31,552 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 857ms, sequenceid=21, compaction requested=true 2023-11-15 19:53:31,552 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:31,552 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:31,552 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:31,552 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:31,552 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,552 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:31,552 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:31,555 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10480b63[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:31,557 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:31,557 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,563 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,563 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:31,563 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:31,563 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:31,564 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,564 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:31,566 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:31,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:31,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:31,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:31,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:31,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:31,569 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:31,570 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:31,570 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:31,570 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,570 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:31,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:31,573 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:31,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:31,573 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,575 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:31,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:31,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:31,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:31,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-15 19:53:31,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,579 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:31,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:31,580 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:31,580 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:31,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:31,680 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:31,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:31,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:31,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:31,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,697 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:31,697 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:31,698 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:31,698 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:31,698 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,698 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,700 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:31,700 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:31,701 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:31,701 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,702 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:31,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:31,703 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:31,703 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:31,703 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:31,703 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:31,703 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:31,703 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:31,703 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:31,704 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:32,130 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311e36ee56405942d3b2e1ff60de4dc73b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512311e36ee56405942d3b2e1ff60de4dc73b 2023-11-15 19:53:32,141 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/042f8db891bc4628a213204c3af8369b 2023-11-15 19:53:32,151 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/042f8db891bc4628a213204c3af8369b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/042f8db891bc4628a213204c3af8369b 2023-11-15 19:53:32,163 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/042f8db891bc4628a213204c3af8369b, entries=1, sequenceid=25, filesize=5.0 K 2023-11-15 19:53:32,165 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 461ms, sequenceid=25, compaction requested=true 2023-11-15 19:53:32,165 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:32,165 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:32,165 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:32,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:32,169 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,169 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:32,170 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,170 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:32,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:32,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:32,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@246313d7[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:32,172 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:32,172 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,174 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,174 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:32,174 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:32,174 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:32,174 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,174 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:32,176 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,176 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:32,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:32,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:32,176 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:32,176 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:32,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:32,180 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:32,181 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:32,181 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:32,181 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,181 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:32,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:32,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:32,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:32,184 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,187 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:32,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:32,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,193 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:32,193 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:32,194 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:32,194 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:32,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:32,295 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:32,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:32,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:32,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:32,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,309 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:32,309 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:32,309 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:32,309 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:32,310 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,310 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,313 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:32,313 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:32,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:32,313 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:32,313 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:32,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:32,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:32,316 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:32,316 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:32,316 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:32,316 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:32,317 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:32,317 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:32,317 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:32,317 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:32,740 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010121bc90d05c594cb4a713d87919895e3c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010121bc90d05c594cb4a713d87919895e3c 2023-11-15 19:53:33,150 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/d173782d42f44f93b7db73ff705797a2 2023-11-15 19:53:33,158 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/d173782d42f44f93b7db73ff705797a2 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/d173782d42f44f93b7db73ff705797a2 2023-11-15 19:53:33,166 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/d173782d42f44f93b7db73ff705797a2, entries=1, sequenceid=29, filesize=5.0 K 2023-11-15 19:53:33,167 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 850ms, sequenceid=29, compaction requested=true 2023-11-15 19:53:33,168 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:33,168 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:33,173 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,173 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:33,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:33,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fbcbd54[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:33,176 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:33,176 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,177 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,177 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:33,177 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:33,178 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,178 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:33,183 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:33,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,183 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:33,183 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:33,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:33,187 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:33,187 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:33,187 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:33,187 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,187 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:33,189 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,189 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,189 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:33,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:33,190 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:33,192 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:33,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,202 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,202 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,203 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:33,203 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:33,203 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:33,203 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:33,203 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,203 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,203 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:33,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:33,207 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:33,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-15 19:53:33,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:33,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:33,208 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:33,208 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:33,308 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:33,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:33,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:33,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:33,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,319 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:33,320 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:33,320 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:33,320 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:33,321 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,321 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,322 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:33,322 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:33,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:33,323 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:33,323 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:33,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:33,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,324 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,324 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:33,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:33,324 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:33,325 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:33,325 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:33,325 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:33,325 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:33,781 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031911081adb5b4d418128a1ca23ec9d2f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031911081adb5b4d418128a1ca23ec9d2f 2023-11-15 19:53:34,190 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/238e48d2111343a1b135191fbac3aadb 2023-11-15 19:53:34,199 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/238e48d2111343a1b135191fbac3aadb as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/238e48d2111343a1b135191fbac3aadb 2023-11-15 19:53:34,207 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/238e48d2111343a1b135191fbac3aadb, entries=1, sequenceid=33, filesize=5.0 K 2023-11-15 19:53:34,208 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 883ms, sequenceid=33, compaction requested=true 2023-11-15 19:53:34,208 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:34,208 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:34,208 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:34,209 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:34,209 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,209 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:34,209 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:34,211 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:34,212 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,212 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:34,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:34,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:34,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:34,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:34,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5deb238b[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:34,214 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:34,214 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,215 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,215 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:34,215 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:34,215 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:34,215 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,216 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:34,217 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:34,217 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,217 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:34,217 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:34,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:34,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:34,222 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:34,222 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:34,222 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:34,222 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,222 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:34,225 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,225 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,225 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:34,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:34,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:34,226 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,228 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:34,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,232 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,232 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,232 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,232 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:34,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:34,232 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:34,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,233 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:34,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:34,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:34,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:34,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-15 19:53:34,234 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:34,234 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:34,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:34,237 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,334 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:34,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:34,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:34,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:34,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,345 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:34,345 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:34,346 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:34,346 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:34,346 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,346 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:34,348 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:34,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:34,348 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:34,348 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:34,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,349 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,349 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:34,349 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:34,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:34,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:34,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:34,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:34,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:34,351 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:34,351 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:34,351 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:34,772 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907619eec9d98974a6d8703d9a008ed395a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907619eec9d98974a6d8703d9a008ed395a 2023-11-15 19:53:35,181 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/bd12b63ecd6a4b58a1787a2dd9b24cad 2023-11-15 19:53:35,189 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/bd12b63ecd6a4b58a1787a2dd9b24cad as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/bd12b63ecd6a4b58a1787a2dd9b24cad 2023-11-15 19:53:35,196 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/bd12b63ecd6a4b58a1787a2dd9b24cad, entries=1, sequenceid=37, filesize=5.0 K 2023-11-15 19:53:35,197 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 846ms, sequenceid=37, compaction requested=true 2023-11-15 19:53:35,197 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:35,197 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:35,197 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:35,200 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,200 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:35,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:35,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d283846[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:35,202 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:35,203 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,205 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:35,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:35,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:35,205 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,205 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:35,207 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,207 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:35,207 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:35,207 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:35,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:35,212 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:35,212 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:35,212 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:35,212 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,212 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:35,214 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,214 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,214 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:35,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:35,215 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:35,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,216 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:35,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,223 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,223 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,223 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:35,223 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,223 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:35,223 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:35,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:35,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:35,224 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:35,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:35,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-15 19:53:35,225 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:35,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:35,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:35,225 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:35,325 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:35,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:35,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:35,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:35,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,335 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:35,335 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:35,335 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-15 19:53:35,335 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-15 19:53:35,336 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,336 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,338 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:35,338 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:35,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:35,339 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,339 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:35,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,340 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,340 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-15 19:53:35,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,340 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-15 19:53:35,340 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-15 19:53:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:35,341 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:35,341 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. started... 2023-11-15 19:53:35,341 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7de5c4100e506844c83d967f1832b74 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:35,360 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112016f1d06ac65e4949838c7e0486b360d8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112016f1d06ac65e4949838c7e0486b360d8 2023-11-15 19:53:35,771 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/fb8222cc519341fcaa134b0dc90a2e07 2023-11-15 19:53:35,780 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/fb8222cc519341fcaa134b0dc90a2e07 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/fb8222cc519341fcaa134b0dc90a2e07 2023-11-15 19:53:35,789 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/fb8222cc519341fcaa134b0dc90a2e07, entries=1, sequenceid=41, filesize=5.0 K 2023-11-15 19:53:35,790 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e7de5c4100e506844c83d967f1832b74 in 449ms, sequenceid=41, compaction requested=true 2023-11-15 19:53:35,790 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:35,790 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:35,790 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-15 19:53:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-15 19:53:35,794 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:35,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:35,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-15 19:53:35,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31696f9f[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:35,796 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-15 19:53:35,796 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,799 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,799 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-15 19:53:35,799 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-15 19:53:35,799 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:35,799 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,799 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:35,801 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,801 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-15 19:53:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:35,801 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:35,801 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-15 19:53:35,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:35,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:35,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-15 19:53:35,806 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-15 19:53:35,807 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:35,807 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:35,807 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,807 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:35,809 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,809 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:35,809 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:35,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:35,814 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,816 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,819 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,819 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,819 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:35,819 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:35,820 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:35,820 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:35,820 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:35,820 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-15 19:53:35,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:35,820 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,820 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,820 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:35,820 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:35,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:35,921 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:35,928 DEBUG [Listener at localhost/43577] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-15 19:53:35,931 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-15 19:53:35,932 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:35,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-15 19:53:35,949 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-15 19:53:35,951 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078615951 2023-11-15 19:53:35,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:53:35,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:53:35,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-15 19:53:35,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:35,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x21650ac2 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:53:35,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d352949, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:53:35,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:36,836 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fb0e26eeab954edb9e951aecfcd472f8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb0e26eeab954edb9e951aecfcd472f8 2023-11-15 19:53:36,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:36,860 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:53:36,861 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:53:36,873 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:53:36,875 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:53:36,914 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cc0b099e39a94f5d8e5855ec42a16e9e first=Optional[r3] last=Optional[r6] 2023-11-15 19:53:36,930 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cc0b099e39a94f5d8e5855ec42a16e9e}] 2023-11-15 19:53:36,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cc0b099e39a94f5d8e5855ec42a16e9e for inclusion in e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:36,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-15 19:53:36,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:53:36,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:36,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cc0b099e39a94f5d8e5855ec42a16e9e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t7aamh64bhc8v1r9hnvp2nojjsp321t5fek9sfvvn37jidfp0dkf4v4eojt9vaje/family1/cc0b099e39a94f5d8e5855ec42a16e9e 2023-11-15 19:53:36,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t7aamh64bhc8v1r9hnvp2nojjsp321t5fek9sfvvn37jidfp0dkf4v4eojt9vaje/family1/cc0b099e39a94f5d8e5855ec42a16e9e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_ 2023-11-15 19:53:36,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t7aamh64bhc8v1r9hnvp2nojjsp321t5fek9sfvvn37jidfp0dkf4v4eojt9vaje/family1/cc0b099e39a94f5d8e5855ec42a16e9e into e7de5c4100e506844c83d967f1832b74/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_ - updating store file list. 2023-11-15 19:53:36,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_ into e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:36,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t7aamh64bhc8v1r9hnvp2nojjsp321t5fek9sfvvn37jidfp0dkf4v4eojt9vaje/family1/cc0b099e39a94f5d8e5855ec42a16e9e into e7de5c4100e506844c83d967f1832b74/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_) 2023-11-15 19:53:36,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t7aamh64bhc8v1r9hnvp2nojjsp321t5fek9sfvvn37jidfp0dkf4v4eojt9vaje/family1/cc0b099e39a94f5d8e5855ec42a16e9e 2023-11-15 19:53:36,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-15 19:53:36,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-15 19:53:36,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): e7de5c4100e506844c83d967f1832b74/family1 is initiating minor compaction 2023-11-15 19:53:36,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7c389d7f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:36,993 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e7de5c4100e506844c83d967f1832b74/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:36,994 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/9f517d3b26d14780b59808850dd27176, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a910329414cb420eb93994128f62c807, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a3b623702f3b42ee8474d0c320d19c73, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/51f098d696e14431a10decb7b74afb84, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/042f8db891bc4628a213204c3af8369b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/d173782d42f44f93b7db73ff705797a2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/238e48d2111343a1b135191fbac3aadb, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/bd12b63ecd6a4b58a1787a2dd9b24cad, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/fb8222cc519341fcaa134b0dc90a2e07, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp, totalSize=50.2 K 2023-11-15 19:53:36,995 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 9f517d3b26d14780b59808850dd27176, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:53:36,995 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting a910329414cb420eb93994128f62c807, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:53:36,995 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting a3b623702f3b42ee8474d0c320d19c73, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-15 19:53:36,995 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 51f098d696e14431a10decb7b74afb84, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-15 19:53:36,995 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 042f8db891bc4628a213204c3af8369b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-15 19:53:36,996 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting d173782d42f44f93b7db73ff705797a2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-15 19:53:36,996 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 238e48d2111343a1b135191fbac3aadb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-15 19:53:36,996 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting bd12b63ecd6a4b58a1787a2dd9b24cad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-15 19:53:36,996 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting fb8222cc519341fcaa134b0dc90a2e07, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-15 19:53:36,996 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 73c264ed48e4497e8f8c7a507f627de5_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-15 19:53:37,009 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:37,011 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:37,016 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d6d40e1795554aff83873e226bba24c1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d6d40e1795554aff83873e226bba24c1 2023-11-15 19:53:37,018 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512311e36ee56405942d3b2e1ff60de4dc73b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512311e36ee56405942d3b2e1ff60de4dc73b 2023-11-15 19:53:37,020 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010121bc90d05c594cb4a713d87919895e3c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010121bc90d05c594cb4a713d87919895e3c 2023-11-15 19:53:37,021 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031911081adb5b4d418128a1ca23ec9d2f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031911081adb5b4d418128a1ca23ec9d2f 2023-11-15 19:53:37,021 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-15 19:53:37,021 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,052 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): e7de5c4100e506844c83d967f1832b74#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:53:37,512 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120514396afab23f4470b46dec7af0216152 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120514396afab23f4470b46dec7af0216152 2023-11-15 19:53:37,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:37,552 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3abb0048df8848729f19f7383c0b5d11 first=Optional[r00] last=Optional[r2] 2023-11-15 19:53:37,554 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3abb0048df8848729f19f7383c0b5d11}] 2023-11-15 19:53:37,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3abb0048df8848729f19f7383c0b5d11 for inclusion in e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:37,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-15 19:53:37,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:53:37,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:37,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3abb0048df8848729f19f7383c0b5d11 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gmaa4j0ssv8k3gnq9mk0gjckqk32sml63ct74kjjqse469cm9800tdnnv2snf1qp/family1/3abb0048df8848729f19f7383c0b5d11 2023-11-15 19:53:37,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gmaa4j0ssv8k3gnq9mk0gjckqk32sml63ct74kjjqse469cm9800tdnnv2snf1qp/family1/3abb0048df8848729f19f7383c0b5d11 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_ 2023-11-15 19:53:37,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gmaa4j0ssv8k3gnq9mk0gjckqk32sml63ct74kjjqse469cm9800tdnnv2snf1qp/family1/3abb0048df8848729f19f7383c0b5d11 into e7de5c4100e506844c83d967f1832b74/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_ - updating store file list. 2023-11-15 19:53:37,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_ into e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:37,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gmaa4j0ssv8k3gnq9mk0gjckqk32sml63ct74kjjqse469cm9800tdnnv2snf1qp/family1/3abb0048df8848729f19f7383c0b5d11 into e7de5c4100e506844c83d967f1832b74/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_) 2023-11-15 19:53:37,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gmaa4j0ssv8k3gnq9mk0gjckqk32sml63ct74kjjqse469cm9800tdnnv2snf1qp/family1/3abb0048df8848729f19f7383c0b5d11 2023-11-15 19:53:37,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:37,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:37,587 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b645987217ed4020a8f56bffbc70d7d1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b645987217ed4020a8f56bffbc70d7d1 2023-11-15 19:53:37,589 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120141f48c5a235c494b8acf2a11199346ef to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120141f48c5a235c494b8acf2a11199346ef 2023-11-15 19:53:37,591 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c071c44af135441b8d250bb1bd339f3a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c071c44af135441b8d250bb1bd339f3a 2023-11-15 19:53:37,591 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-15 19:53:37,591 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-15 19:53:37,592 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:37,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:37,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:53:37,594 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-15 19:53:37,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6560 sec 2023-11-15 19:53:37,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-15 19:53:37,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:37,761 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-15 19:53:37,763 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-15 19:53:37,763 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-15 19:53:37,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-15 19:53:37,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, REOPEN/MOVE}] 2023-11-15 19:53:37,780 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, REOPEN/MOVE 2023-11-15 19:53:37,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e7de5c4100e506844c83d967f1832b74, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:37,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700078017781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078017781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078017781"}]},"ts":"1700078017781"} 2023-11-15 19:53:37,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure e7de5c4100e506844c83d967f1832b74, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:53:37,881 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/62615e796758495392cb47fa9c884106 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/62615e796758495392cb47fa9c884106 2023-11-15 19:53:37,895 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e7de5c4100e506844c83d967f1832b74/family1 of e7de5c4100e506844c83d967f1832b74 into 62615e796758495392cb47fa9c884106(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:53:37,896 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:37,897 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700078016991; duration=0sec 2023-11-15 19:53:37,898 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:37,943 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:37,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/9f517d3b26d14780b59808850dd27176, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a910329414cb420eb93994128f62c807, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a3b623702f3b42ee8474d0c320d19c73, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/51f098d696e14431a10decb7b74afb84, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/042f8db891bc4628a213204c3af8369b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/d173782d42f44f93b7db73ff705797a2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/238e48d2111343a1b135191fbac3aadb, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/bd12b63ecd6a4b58a1787a2dd9b24cad, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/fb8222cc519341fcaa134b0dc90a2e07, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_] to archive 2023-11-15 19:53:37,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:37,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:37,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7de5c4100e506844c83d967f1832b74, disabling compactions & flushes 2023-11-15 19:53:37,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:37,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:37,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. after waiting 0 ms 2023-11-15 19:53:37,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:37,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/9f517d3b26d14780b59808850dd27176 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/9f517d3b26d14780b59808850dd27176 2023-11-15 19:53:37,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a910329414cb420eb93994128f62c807 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a910329414cb420eb93994128f62c807 2023-11-15 19:53:37,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a3b623702f3b42ee8474d0c320d19c73 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/a3b623702f3b42ee8474d0c320d19c73 2023-11-15 19:53:37,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/51f098d696e14431a10decb7b74afb84 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/51f098d696e14431a10decb7b74afb84 2023-11-15 19:53:37,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/042f8db891bc4628a213204c3af8369b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/042f8db891bc4628a213204c3af8369b 2023-11-15 19:53:37,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/d173782d42f44f93b7db73ff705797a2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/d173782d42f44f93b7db73ff705797a2 2023-11-15 19:53:37,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/238e48d2111343a1b135191fbac3aadb to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/238e48d2111343a1b135191fbac3aadb 2023-11-15 19:53:37,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/bd12b63ecd6a4b58a1787a2dd9b24cad to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/bd12b63ecd6a4b58a1787a2dd9b24cad 2023-11-15 19:53:37,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/fb8222cc519341fcaa134b0dc90a2e07 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/fb8222cc519341fcaa134b0dc90a2e07 2023-11-15 19:53:37,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/73c264ed48e4497e8f8c7a507f627de5_SeqId_44_ 2023-11-15 19:53:37,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-15 19:53:37,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:37,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:37,991 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e7de5c4100e506844c83d967f1832b74 to self. 2023-11-15 19:53:37,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:37,994 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e7de5c4100e506844c83d967f1832b74, regionState=CLOSED 2023-11-15 19:53:37,994 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700078017994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078017994"}]},"ts":"1700078017994"} 2023-11-15 19:53:37,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-15 19:53:37,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure e7de5c4100e506844c83d967f1832b74, server=jenkins-hbase4.apache.org,42249,1700078002491 in 212 msec 2023-11-15 19:53:37,999 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=true 2023-11-15 19:53:38,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e7de5c4100e506844c83d967f1832b74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:38,150 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700078018149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078018149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078018149"}]},"ts":"1700078018149"} 2023-11-15 19:53:38,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure e7de5c4100e506844c83d967f1832b74, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:53:38,305 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:38,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:38,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7de5c4100e506844c83d967f1832b74, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:53:38,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:38,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:38,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:38,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:38,310 INFO [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:38,312 DEBUG [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:38,312 DEBUG [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:38,312 INFO [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7de5c4100e506844c83d967f1832b74 columnFamilyName family1 2023-11-15 19:53:38,321 DEBUG [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/2bf2444d0f354fdcbf894999f7f75652 2023-11-15 19:53:38,327 DEBUG [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/62615e796758495392cb47fa9c884106 2023-11-15 19:53:38,331 DEBUG [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_ 2023-11-15 19:53:38,332 INFO [StoreOpener-e7de5c4100e506844c83d967f1832b74-1] regionserver.HStore(310): Store=e7de5c4100e506844c83d967f1832b74/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:38,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:38,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:38,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7de5c4100e506844c83d967f1832b74 2023-11-15 19:53:38,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7de5c4100e506844c83d967f1832b74; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69179911, jitterRate=0.030861005187034607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:53:38,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:38,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74., pid=17, masterSystemTime=1700078018305 2023-11-15 19:53:38,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:38,340 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-15 19:53:38,342 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-15 19:53:38,342 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1912): e7de5c4100e506844c83d967f1832b74/family1 is initiating minor compaction (all files) 2023-11-15 19:53:38,342 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e7de5c4100e506844c83d967f1832b74/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:38,342 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/2bf2444d0f354fdcbf894999f7f75652, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/62615e796758495392cb47fa9c884106, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp, totalSize=358.6 K 2023-11-15 19:53:38,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:38,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:53:38,343 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 2bf2444d0f354fdcbf894999f7f75652, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826299 2023-11-15 19:53:38,343 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e7de5c4100e506844c83d967f1832b74, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:38,343 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 62615e796758495392cb47fa9c884106, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226299 2023-11-15 19:53:38,343 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700078018343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078018343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078018343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078018343"}]},"ts":"1700078018343"} 2023-11-15 19:53:38,344 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878826299 2023-11-15 19:53:38,348 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-15 19:53:38,348 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure e7de5c4100e506844c83d967f1832b74, server=jenkins-hbase4.apache.org,42249,1700078002491 in 193 msec 2023-11-15 19:53:38,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-15 19:53:38,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e7de5c4100e506844c83d967f1832b74, REOPEN/MOVE in 569 msec 2023-11-15 19:53:38,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-15 19:53:38,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 586 msec 2023-11-15 19:53:38,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 613 msec 2023-11-15 19:53:38,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-15 19:53:38,372 INFO [Listener at localhost/43577] compactions.TestMobCompactor(278): alter status finished 2023-11-15 19:53:38,373 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): e7de5c4100e506844c83d967f1832b74#family1#compaction#11 average throughput is 8.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:53:38,373 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-15 19:53:38,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-15 19:53:38,378 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-15 19:53:38,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:53:38,381 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078618381 2023-11-15 19:53:38,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:53:38,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-15 19:53:38,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:38,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x146262fb to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:53:38,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bed6019, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:53:38,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,444 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281be4a8f22e4a40ddaf89b1fac31977c7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511281be4a8f22e4a40ddaf89b1fac31977c7 2023-11-15 19:53:38,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:38,461 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:53:38,463 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:53:38,479 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:53:38,481 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:53:38,499 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92241591dd7e4ec497e89b935325deda first=Optional[r05] last=Optional[r8] 2023-11-15 19:53:38,500 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=50 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92241591dd7e4ec497e89b935325deda}] 2023-11-15 19:53:38,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92241591dd7e4ec497e89b935325deda for inclusion in e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:38,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-15 19:53:38,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:53:38,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:38,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/92241591dd7e4ec497e89b935325deda to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kfn70v5gpf2rrgncnhqo1tqanugoriaurt2j8i565t1pa1100stoga9f4h2u371p/family1/92241591dd7e4ec497e89b935325deda 2023-11-15 19:53:38,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kfn70v5gpf2rrgncnhqo1tqanugoriaurt2j8i565t1pa1100stoga9f4h2u371p/family1/92241591dd7e4ec497e89b935325deda as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/59a27d96c1e24ca7a2e33c6be1a4813b_SeqId_52_ 2023-11-15 19:53:38,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kfn70v5gpf2rrgncnhqo1tqanugoriaurt2j8i565t1pa1100stoga9f4h2u371p/family1/92241591dd7e4ec497e89b935325deda into e7de5c4100e506844c83d967f1832b74/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/59a27d96c1e24ca7a2e33c6be1a4813b_SeqId_52_ - updating store file list. 2023-11-15 19:53:38,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/59a27d96c1e24ca7a2e33c6be1a4813b_SeqId_52_ into e7de5c4100e506844c83d967f1832b74/family1 2023-11-15 19:53:38,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kfn70v5gpf2rrgncnhqo1tqanugoriaurt2j8i565t1pa1100stoga9f4h2u371p/family1/92241591dd7e4ec497e89b935325deda into e7de5c4100e506844c83d967f1832b74/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/59a27d96c1e24ca7a2e33c6be1a4813b_SeqId_52_) 2023-11-15 19:53:38,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kfn70v5gpf2rrgncnhqo1tqanugoriaurt2j8i565t1pa1100stoga9f4h2u371p/family1/92241591dd7e4ec497e89b935325deda 2023-11-15 19:53:38,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:38,533 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:38,536 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112016f1d06ac65e4949838c7e0486b360d8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112016f1d06ac65e4949838c7e0486b360d8 2023-11-15 19:53:38,538 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511282541716b49404ff49aefa32c76048dd7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511282541716b49404ff49aefa32c76048dd7 2023-11-15 19:53:38,538 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-15 19:53:38,538 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-15 19:53:38,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-15 19:53:38,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-15 19:53:38,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:53:38,541 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-15 19:53:38,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 166 msec 2023-11-15 19:53:38,658 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=257 (was 213) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57372 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-300 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57390 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120552f6f7293297451c87d13dae0e10496d_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50885@0x21650ac2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/729866772.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50885@0x146262fb sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/729866772.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57454 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:42249-shortCompactions-0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:940) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:880) org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:863) org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:818) org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.finishClose(HFileWriterImpl.java:820) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.close(HFileWriterImpl.java:654) org.apache.hadoop.hbase.regionserver.StoreFileWriter.close(StoreFileWriter.java:359) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.abortWriter(DefaultCompactor.java:97) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.performCompaction(DefaultMobStoreCompactor.java:339) org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:337) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.compact(DefaultMobStoreCompactor.java:108) org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:122) org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1473) org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:2267) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:625) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:673) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57568 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57460 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x60a986ba-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57334 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57362 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50885@0x146262fb-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1526793477_17 at /127.0.0.1:57572 [Receiving block BP-107386809-172.31.14.131-1700077997855:blk_1073741865_1041] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/717edd013ecb4d3390cb298926de7598 block BP-107386809-172.31.14.131-1700077997855:blk_1073741865_1041 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57444 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-107386809-172.31.14.131-1700077997855:blk_1073741865_1041, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:47012 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-107386809-172.31.14.131-1700077997855:blk_1073741865_1041 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hconnection-0x60a986ba-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57432 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50885@0x21650ac2-SendThread(127.0.0.1:50885) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: hconnection-0x79bab308-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57558 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57354 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1526793477_17 at /127.0.0.1:57382 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79bab308-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_173196517_17 at /127.0.0.1:57420 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x60a986ba-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50885@0x21650ac2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50885@0x146262fb-SendThread(127.0.0.1:50885) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) - Thread LEAK? -, OpenFileDescriptor=623 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 308), ProcessCount=171 (was 171), AvailableMemoryMB=1327 (was 1649) 2023-11-15 19:53:38,675 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=257, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=171, AvailableMemoryMB=1326 2023-11-15 19:53:38,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-15 19:53:38,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:38,681 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:53:38,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-15 19:53:38,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-15 19:53:38,685 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:53:38,687 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821 2023-11-15 19:53:38,688 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821 empty. 2023-11-15 19:53:38,689 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821 2023-11-15 19:53:38,689 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-15 19:53:38,711 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-15 19:53:38,712 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 90ca860037191a24937594b3f2e23821, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:53:38,724 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:38,724 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 90ca860037191a24937594b3f2e23821, disabling compactions & flushes 2023-11-15 19:53:38,724 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:38,724 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:38,724 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. after waiting 0 ms 2023-11-15 19:53:38,724 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:38,724 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:38,724 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:38,727 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:53:38,728 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700078018728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078018728"}]},"ts":"1700078018728"} 2023-11-15 19:53:38,730 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:53:38,731 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:53:38,731 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078018731"}]},"ts":"1700078018731"} 2023-11-15 19:53:38,733 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-15 19:53:38,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-15 19:53:38,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=90ca860037191a24937594b3f2e23821, ASSIGN}] 2023-11-15 19:53:38,823 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=90ca860037191a24937594b3f2e23821, ASSIGN 2023-11-15 19:53:38,824 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=90ca860037191a24937594b3f2e23821, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:53:38,975 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=90ca860037191a24937594b3f2e23821, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:38,975 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700078018975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078018975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078018975"}]},"ts":"1700078018975"} 2023-11-15 19:53:38,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 90ca860037191a24937594b3f2e23821, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:53:38,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-15 19:53:39,129 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:39,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:39,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90ca860037191a24937594b3f2e23821, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:53:39,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 90ca860037191a24937594b3f2e23821 2023-11-15 19:53:39,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:39,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 90ca860037191a24937594b3f2e23821 2023-11-15 19:53:39,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 90ca860037191a24937594b3f2e23821 2023-11-15 19:53:39,135 INFO [StoreOpener-90ca860037191a24937594b3f2e23821-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 90ca860037191a24937594b3f2e23821 2023-11-15 19:53:39,137 DEBUG [StoreOpener-90ca860037191a24937594b3f2e23821-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:39,137 DEBUG [StoreOpener-90ca860037191a24937594b3f2e23821-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:39,138 INFO [StoreOpener-90ca860037191a24937594b3f2e23821-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90ca860037191a24937594b3f2e23821 columnFamilyName family1 2023-11-15 19:53:39,139 INFO [StoreOpener-90ca860037191a24937594b3f2e23821-1] regionserver.HStore(310): Store=90ca860037191a24937594b3f2e23821/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:39,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821 2023-11-15 19:53:39,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821 2023-11-15 19:53:39,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 90ca860037191a24937594b3f2e23821 2023-11-15 19:53:39,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:53:39,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 90ca860037191a24937594b3f2e23821; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59193825, jitterRate=-0.11794327199459076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:53:39,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:39,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821., pid=21, masterSystemTime=1700078019129 2023-11-15 19:53:39,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:39,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:39,150 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=90ca860037191a24937594b3f2e23821, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:39,150 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700078019150"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078019150"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078019150"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078019150"}]},"ts":"1700078019150"} 2023-11-15 19:53:39,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-15 19:53:39,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 90ca860037191a24937594b3f2e23821, server=jenkins-hbase4.apache.org,42249,1700078002491 in 175 msec 2023-11-15 19:53:39,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-15 19:53:39,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=90ca860037191a24937594b3f2e23821, ASSIGN in 333 msec 2023-11-15 19:53:39,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:53:39,157 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078019157"}]},"ts":"1700078019157"} 2023-11-15 19:53:39,159 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-15 19:53:39,191 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:53:39,193 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 513 msec 2023-11-15 19:53:39,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-15 19:53:39,288 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-15 19:53:39,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:39,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,331 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:39,331 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:39,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:39,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:39,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,374 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:39,374 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:39,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:39,375 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:39,375 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:39,376 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:39,376 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:39,377 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:39,377 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:39,378 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-15 19:53:39,614 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/.tmp/family1/717edd013ecb4d3390cb298926de7598 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/717edd013ecb4d3390cb298926de7598 2023-11-15 19:53:39,622 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e7de5c4100e506844c83d967f1832b74/family1 of e7de5c4100e506844c83d967f1832b74 into 717edd013ecb4d3390cb298926de7598(size=177.2 K), total size for store is 182.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:53:39,622 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:53:39,622 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74., storeName=e7de5c4100e506844c83d967f1832b74/family1, priority=13, startTime=1700078018339; duration=1sec 2023-11-15 19:53:39,622 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:39,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/2bf2444d0f354fdcbf894999f7f75652, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/62615e796758495392cb47fa9c884106, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_] to archive 2023-11-15 19:53:39,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:39,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/2bf2444d0f354fdcbf894999f7f75652 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/2bf2444d0f354fdcbf894999f7f75652 2023-11-15 19:53:39,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/62615e796758495392cb47fa9c884106 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/62615e796758495392cb47fa9c884106 2023-11-15 19:53:39,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/family1/c2aa0219d08f47f4bd80db501a6495dd_SeqId_46_ 2023-11-15 19:53:39,801 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130897e3e6effd8418283f19548e093ddb5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130897e3e6effd8418283f19548e093ddb5 2023-11-15 19:53:40,206 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/44e7c297a72845389fa941856ff367e6 2023-11-15 19:53:40,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/44e7c297a72845389fa941856ff367e6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/44e7c297a72845389fa941856ff367e6 2023-11-15 19:53:40,218 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/44e7c297a72845389fa941856ff367e6, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-15 19:53:40,219 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 841ms, sequenceid=5, compaction requested=false 2023-11-15 19:53:40,219 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:40,220 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:40,220 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:40,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:40,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:40,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:40,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:40,274 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,274 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:40,275 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,275 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:40,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:40,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:40,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:40,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b9532fb[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:40,277 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:40,277 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,328 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,328 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:40,328 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:40,329 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:40,329 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,329 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:40,382 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:40,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:40,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:40,386 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:40,386 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:40,386 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:40,386 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,386 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:40,428 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,428 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:40,428 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:40,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:40,429 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,431 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,667 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,667 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,667 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:40,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:40,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:40,667 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:40,667 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,667 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,667 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:40,667 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:40,668 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:40,668 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,668 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:40,668 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:40,769 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:40,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:40,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:40,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:40,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,778 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:40,778 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:40,778 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:40,778 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:40,779 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,779 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,836 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,836 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:40,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:40,837 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:40,837 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:40,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:40,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,838 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:40,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:40,838 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:40,838 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:40,839 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:40,839 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:40,839 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:40,839 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:40,839 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:40,839 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-15 19:53:41,254 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c598c5694b0c484fb189672fc105db5e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c598c5694b0c484fb189672fc105db5e 2023-11-15 19:53:41,660 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/5b5c215aeb694139bffc767ddaca429d 2023-11-15 19:53:41,667 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/5b5c215aeb694139bffc767ddaca429d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/5b5c215aeb694139bffc767ddaca429d 2023-11-15 19:53:41,672 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/5b5c215aeb694139bffc767ddaca429d, entries=1, sequenceid=9, filesize=5.0 K 2023-11-15 19:53:41,674 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 835ms, sequenceid=9, compaction requested=false 2023-11-15 19:53:41,674 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:41,674 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:41,674 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:41,674 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:41,675 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,675 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:41,675 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:41,736 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,736 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:41,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:41,736 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:41,736 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:41,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:41,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:41,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:41,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fe6bd79[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:41,738 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:41,738 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,790 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,790 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:41,790 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:41,790 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:41,790 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,790 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:41,851 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,851 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:41,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:41,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:41,855 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:41,855 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:41,855 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:41,855 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,855 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:41,874 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,874 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:41,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,874 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:41,875 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:41,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:41,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,877 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,928 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,928 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:41,928 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,928 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:41,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:41,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:53:41,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:41,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:41,928 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,928 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:41,929 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:41,929 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,929 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,929 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:41,929 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:41,930 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:41,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:42,030 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:42,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:42,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:42,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:42,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,038 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:42,038 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:42,038 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:42,038 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:42,039 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,039 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,067 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,067 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:42,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:42,067 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,067 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,068 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:42,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,068 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:42,069 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:42,069 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:42,069 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:42,069 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:42,069 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:42,069 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:42,069 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:42,484 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a50377170d65450faec2c16cf85155e4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a50377170d65450faec2c16cf85155e4 2023-11-15 19:53:42,890 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/246701737f3842349b73780a5d46b23d 2023-11-15 19:53:42,897 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/246701737f3842349b73780a5d46b23d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/246701737f3842349b73780a5d46b23d 2023-11-15 19:53:42,901 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/246701737f3842349b73780a5d46b23d, entries=1, sequenceid=13, filesize=4.9 K 2023-11-15 19:53:42,902 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 833ms, sequenceid=13, compaction requested=true 2023-11-15 19:53:42,902 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:42,903 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:42,905 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:42,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:42,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:42,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:42,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:42,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:42,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53404ccb[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:42,907 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:42,907 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,908 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,908 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:42,908 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:42,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:42,909 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,909 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:42,910 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,910 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:42,910 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:42,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:42,910 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:42,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:42,915 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:42,915 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:42,915 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:42,915 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,915 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:42,918 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,918 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:42,918 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:42,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:42,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,921 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:42,924 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:42,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:42,925 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:42,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:42,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:42,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:42,926 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:42,926 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:43,026 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:43,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:43,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:43,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:43,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,035 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:43,035 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:43,035 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:43,035 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:43,036 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,036 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,037 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,037 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:43,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:43,038 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,038 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,039 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,039 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:43,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,039 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:43,039 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:43,040 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:43,040 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:43,040 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:43,040 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:43,040 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:43,040 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:43,458 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055adb87841d51428d96d549964262f70f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512055adb87841d51428d96d549964262f70f 2023-11-15 19:53:43,517 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:53:43,867 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6 2023-11-15 19:53:43,873 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6 2023-11-15 19:53:43,878 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6, entries=1, sequenceid=17, filesize=4.9 K 2023-11-15 19:53:43,879 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 839ms, sequenceid=17, compaction requested=true 2023-11-15 19:53:43,879 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:43,879 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:43,880 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:43,880 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:43,880 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,880 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:43,880 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:43,882 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,882 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:43,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:43,882 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,882 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:43,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:43,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:43,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:43,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:43,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29afd4ab[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:43,884 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:43,884 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,886 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,886 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:43,886 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:43,886 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:43,886 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,887 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:43,892 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:43,892 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,892 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:43,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:43,892 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:43,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:43,895 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:43,896 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:43,896 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:43,896 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,896 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:43,898 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,898 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,898 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:43,898 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,900 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,903 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,903 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,903 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:43,903 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:43,903 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:43,903 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:43,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:53:43,903 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:43,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:43,903 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:43,904 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:43,904 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:43,904 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:43,904 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:44,004 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:44,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:44,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:44,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:44,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,015 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:44,015 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:44,015 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:44,015 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:44,016 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,016 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,022 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,022 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:44,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:44,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:44,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,023 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,023 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:44,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:44,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,029 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:44,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,029 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:44,029 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:44,033 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:44,033 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:44,033 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:44,033 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:44,033 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:44,078 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283fb0a739f910464ba6aa45e107e2e83a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512283fb0a739f910464ba6aa45e107e2e83a 2023-11-15 19:53:44,089 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/719b157c11224c20be1da739943d865b 2023-11-15 19:53:44,096 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/719b157c11224c20be1da739943d865b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/719b157c11224c20be1da739943d865b 2023-11-15 19:53:44,102 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/719b157c11224c20be1da739943d865b, entries=1, sequenceid=21, filesize=4.9 K 2023-11-15 19:53:44,103 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 70ms, sequenceid=21, compaction requested=true 2023-11-15 19:53:44,104 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:44,104 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:44,106 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,106 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,107 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,107 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:44,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:44,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:44,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:44,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:44,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:44,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:44,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1f398f[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:44,111 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:44,111 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:44,113 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,113 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:44,115 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,115 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:44,115 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:44,115 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:44,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:44,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:44,119 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:44,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:44,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:44,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,119 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:44,124 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,124 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:44,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:44,124 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:44,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:44,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,128 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,130 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,133 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:44,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:44,134 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:44,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:44,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:44,138 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:44,138 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:44,238 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:44,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:44,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:44,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:44,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,256 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:44,256 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:44,256 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:44,256 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:44,257 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,257 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,259 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,259 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:44,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:44,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:44,260 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:44,260 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,262 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:44,262 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:44,262 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:44,263 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:44,265 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:44,265 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:44,265 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:44,265 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:44,265 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:44,699 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e00118ec3d0a4d2d8160fadb7dfcda08 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e00118ec3d0a4d2d8160fadb7dfcda08 2023-11-15 19:53:45,111 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/9bd5a24f6a1647a8abf18ed52713f4f5 2023-11-15 19:53:45,117 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/9bd5a24f6a1647a8abf18ed52713f4f5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/9bd5a24f6a1647a8abf18ed52713f4f5 2023-11-15 19:53:45,122 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/9bd5a24f6a1647a8abf18ed52713f4f5, entries=1, sequenceid=25, filesize=4.9 K 2023-11-15 19:53:45,123 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 858ms, sequenceid=25, compaction requested=true 2023-11-15 19:53:45,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:45,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:45,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:45,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:45,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:45,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:45,125 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,125 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:45,125 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,125 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:45,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:45,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31b852e0[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:45,127 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:45,127 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,129 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:45,130 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,130 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:45,131 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,131 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:45,131 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:45,131 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:45,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:45,134 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:45,134 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:45,134 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:45,134 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,134 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:45,136 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,136 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:45,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,136 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:45,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:45,137 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,138 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:45,141 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:45,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:45,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:45,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,142 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:45,142 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:45,142 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:45,242 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:45,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:45,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,251 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:45,251 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:45,251 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:45,251 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:45,252 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,252 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,254 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,254 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:45,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:45,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:45,254 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:45,254 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:45,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:45,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:45,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:45,257 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:45,257 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:45,257 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:45,257 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:45,671 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101735c898c4f964a499e566d3a3bc46671 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101735c898c4f964a499e566d3a3bc46671 2023-11-15 19:53:46,078 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/3580aebde904409282041db7de262252 2023-11-15 19:53:46,083 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/3580aebde904409282041db7de262252 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/3580aebde904409282041db7de262252 2023-11-15 19:53:46,088 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/3580aebde904409282041db7de262252, entries=1, sequenceid=29, filesize=4.9 K 2023-11-15 19:53:46,089 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 832ms, sequenceid=29, compaction requested=true 2023-11-15 19:53:46,089 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:46,089 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:46,096 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,096 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:46,096 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,097 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:46,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:46,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@604f6608[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:46,098 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:46,098 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:46,100 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,100 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:46,101 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,101 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:46,101 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:46,102 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:46,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:46,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:46,104 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:46,105 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:46,105 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:46,105 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,105 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:46,108 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,108 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:46,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,108 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:46,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:46,109 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,110 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,113 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:46,113 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:46,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:46,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:46,114 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:46,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:53:46,114 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:46,115 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:46,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:46,215 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:46,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:46,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:46,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:46,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,224 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:46,224 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:46,225 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:46,225 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:46,225 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,225 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,227 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,227 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:46,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:46,227 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:46,227 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,228 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,229 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:46,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:46,230 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:46,230 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:46,230 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:46,230 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:46,230 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:46,649 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010324f2b3690c5f4fc2b18f0cab487cd417 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010324f2b3690c5f4fc2b18f0cab487cd417 2023-11-15 19:53:47,055 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/a62e00f177144ec09844439af186982a 2023-11-15 19:53:47,061 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/a62e00f177144ec09844439af186982a as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/a62e00f177144ec09844439af186982a 2023-11-15 19:53:47,066 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/a62e00f177144ec09844439af186982a, entries=1, sequenceid=33, filesize=4.9 K 2023-11-15 19:53:47,067 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 837ms, sequenceid=33, compaction requested=true 2023-11-15 19:53:47,067 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:47,067 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:47,071 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:47,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:47,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3712fc26[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:47,073 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:47,073 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,076 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,076 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:47,077 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,077 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:47,107 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,107 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:47,107 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:47,107 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:47,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:47,111 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:47,111 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:47,111 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:47,111 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,111 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:47,130 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,130 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:47,130 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:47,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:47,131 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:47,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,133 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,161 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,161 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:47,161 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:47,161 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,161 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:47,161 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,161 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:47,161 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:47,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:47,162 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:47,162 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,162 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:47,162 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:47,263 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:47,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:47,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:47,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:47,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,272 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:47,272 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:47,272 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:47,272 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:47,273 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,273 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,299 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:47,299 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:47,300 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,300 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,301 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:47,302 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:47,302 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:47,302 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:47,320 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076628a6fd86954e46b16bd4315da2130d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509076628a6fd86954e46b16bd4315da2130d 2023-11-15 19:53:47,325 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/d9ac8ac742e84882b1e4ffac19b8cc7b 2023-11-15 19:53:47,330 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/d9ac8ac742e84882b1e4ffac19b8cc7b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/d9ac8ac742e84882b1e4ffac19b8cc7b 2023-11-15 19:53:47,335 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/d9ac8ac742e84882b1e4ffac19b8cc7b, entries=1, sequenceid=37, filesize=4.9 K 2023-11-15 19:53:47,336 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 34ms, sequenceid=37, compaction requested=true 2023-11-15 19:53:47,336 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:47,336 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:47,336 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:47,336 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:47,336 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,336 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:47,336 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:47,392 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,392 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:47,393 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,393 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:47,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:47,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55a3780a[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:47,395 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:47,395 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,438 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,438 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:47,438 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,438 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:47,438 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:47,438 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:47,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:47,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:47,488 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:47,488 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:47,488 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:47,488 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,488 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:47,538 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,538 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,538 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:47,538 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:47,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:47,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:47,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,540 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,650 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,650 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:47,650 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:47,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:47,650 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:47,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:53:47,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:47,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:47,650 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:47,651 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,651 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,651 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,651 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,651 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,651 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:47,652 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:47,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:47,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:47,752 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:47,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:47,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:47,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:47,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,760 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:47,760 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:47,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:53:47,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:47,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,784 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,784 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:47,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:47,784 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:47,784 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,785 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,785 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:53:47,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:47,786 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:53:47,786 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:47,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:53:47,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:47,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:47,787 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:47,787 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. started... 2023-11-15 19:53:47,787 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 90ca860037191a24937594b3f2e23821 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:48,203 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120858a06f19e224654b2f1eaea267310d9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120858a06f19e224654b2f1eaea267310d9 2023-11-15 19:53:48,609 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/f3d88d6854d24484ac8899e3a7c47a6e 2023-11-15 19:53:48,615 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/f3d88d6854d24484ac8899e3a7c47a6e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/f3d88d6854d24484ac8899e3a7c47a6e 2023-11-15 19:53:48,621 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/f3d88d6854d24484ac8899e3a7c47a6e, entries=1, sequenceid=41, filesize=4.9 K 2023-11-15 19:53:48,622 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 90ca860037191a24937594b3f2e23821 in 835ms, sequenceid=41, compaction requested=true 2023-11-15 19:53:48,622 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:48,622 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:53:48,624 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,624 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:48,624 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,624 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@267f1f0c[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:48,626 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:48,626 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,628 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:53:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:48,629 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,629 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:48,630 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,630 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:53:48,630 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:48,630 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:48,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:48,633 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:53:48,633 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:48,633 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:48,633 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,633 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:48,635 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,635 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:48,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,635 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:48,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:48,636 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,637 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:48,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:53:48,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:48,640 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:48,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:48,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-15 19:53:48,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:48,639 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:48,641 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:48,641 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:48,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:48,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:48,741 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:48,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:48,744 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-15 19:53:48,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:53:48,747 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:53:48,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:53:48,748 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078628748 2023-11-15 19:53:48,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:53:48,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-15 19:53:48,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:48,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x1a2b3ab5 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:53:48,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@369be31c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:53:48,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:49,590 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d7c46928c8294b8cbaf08e9fd78fef10 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103d7c46928c8294b8cbaf08e9fd78fef10 2023-11-15 19:53:49,591 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:49,603 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:53:49,604 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:53:49,611 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:53:49,612 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:53:49,622 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0d602ed115744417ad19ee9f91c6dcb4 first=Optional[r5] last=Optional[r6] 2023-11-15 19:53:49,622 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0d602ed115744417ad19ee9f91c6dcb4}] 2023-11-15 19:53:49,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0d602ed115744417ad19ee9f91c6dcb4 for inclusion in 90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:49,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-15 19:53:49,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:53:49,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:49,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/0d602ed115744417ad19ee9f91c6dcb4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8b0br9kr560lhttgt1vhgjhiu2p3ea2q8hknm28mjuf0fb0cptv5hcg30o6vq7je/family1/0d602ed115744417ad19ee9f91c6dcb4 2023-11-15 19:53:49,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8b0br9kr560lhttgt1vhgjhiu2p3ea2q8hknm28mjuf0fb0cptv5hcg30o6vq7je/family1/0d602ed115744417ad19ee9f91c6dcb4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_ 2023-11-15 19:53:49,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8b0br9kr560lhttgt1vhgjhiu2p3ea2q8hknm28mjuf0fb0cptv5hcg30o6vq7je/family1/0d602ed115744417ad19ee9f91c6dcb4 into 90ca860037191a24937594b3f2e23821/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_ - updating store file list. 2023-11-15 19:53:49,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_ into 90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:49,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8b0br9kr560lhttgt1vhgjhiu2p3ea2q8hknm28mjuf0fb0cptv5hcg30o6vq7je/family1/0d602ed115744417ad19ee9f91c6dcb4 into 90ca860037191a24937594b3f2e23821/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_) 2023-11-15 19:53:49,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8b0br9kr560lhttgt1vhgjhiu2p3ea2q8hknm28mjuf0fb0cptv5hcg30o6vq7je/family1/0d602ed115744417ad19ee9f91c6dcb4 2023-11-15 19:53:49,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-15 19:53:49,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-15 19:53:49,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 90ca860037191a24937594b3f2e23821/family1 is initiating minor compaction 2023-11-15 19:53:49,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@783fd237; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:49,642 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 90ca860037191a24937594b3f2e23821/family1 in testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:49,642 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/5b5c215aeb694139bffc767ddaca429d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/246701737f3842349b73780a5d46b23d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/719b157c11224c20be1da739943d865b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/9bd5a24f6a1647a8abf18ed52713f4f5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/3580aebde904409282041db7de262252, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/a62e00f177144ec09844439af186982a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/d9ac8ac742e84882b1e4ffac19b8cc7b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/f3d88d6854d24484ac8899e3a7c47a6e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp, totalSize=49.7 K 2023-11-15 19:53:49,642 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 5b5c215aeb694139bffc767ddaca429d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:53:49,642 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 246701737f3842349b73780a5d46b23d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:53:49,642 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 12e3d0a8bbdb4eca8fde4910ff41f1f6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-15 19:53:49,642 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 719b157c11224c20be1da739943d865b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-15 19:53:49,642 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 9bd5a24f6a1647a8abf18ed52713f4f5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-15 19:53:49,642 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3580aebde904409282041db7de262252, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-15 19:53:49,642 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting a62e00f177144ec09844439af186982a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-15 19:53:49,643 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting d9ac8ac742e84882b1e4ffac19b8cc7b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-15 19:53:49,643 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting f3d88d6854d24484ac8899e3a7c47a6e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-15 19:53:49,643 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 06960259873d4babb4d40caef44db3cc_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-15 19:53:49,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:49,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:49,647 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101735c898c4f964a499e566d3a3bc46671 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101735c898c4f964a499e566d3a3bc46671 2023-11-15 19:53:49,649 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010324f2b3690c5f4fc2b18f0cab487cd417 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010324f2b3690c5f4fc2b18f0cab487cd417 2023-11-15 19:53:49,649 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-15 19:53:49,649 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-15 19:53:49,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:49,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:49,687 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 90ca860037191a24937594b3f2e23821#family1#compaction#22 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:53:50,504 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/10cc428dda804c4e97306d4a7154709b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/10cc428dda804c4e97306d4a7154709b 2023-11-15 19:53:50,507 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a24888269748409a96626393a8d9c33b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a24888269748409a96626393a8d9c33b 2023-11-15 19:53:50,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:50,511 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 90ca860037191a24937594b3f2e23821/family1 of 90ca860037191a24937594b3f2e23821 into 10cc428dda804c4e97306d4a7154709b(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:53:50,511 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:50,511 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700078029642; duration=0sec 2023-11-15 19:53:50,511 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:50,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/5b5c215aeb694139bffc767ddaca429d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/246701737f3842349b73780a5d46b23d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/719b157c11224c20be1da739943d865b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/9bd5a24f6a1647a8abf18ed52713f4f5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/3580aebde904409282041db7de262252, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/a62e00f177144ec09844439af186982a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/d9ac8ac742e84882b1e4ffac19b8cc7b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/f3d88d6854d24484ac8899e3a7c47a6e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_] to archive 2023-11-15 19:53:50,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:50,547 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fada62bc2e343d385ace1bf43cb65ca first=Optional[r1] last=Optional[r4] 2023-11-15 19:53:50,548 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fada62bc2e343d385ace1bf43cb65ca}] 2023-11-15 19:53:50,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/5b5c215aeb694139bffc767ddaca429d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/5b5c215aeb694139bffc767ddaca429d 2023-11-15 19:53:50,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fada62bc2e343d385ace1bf43cb65ca for inclusion in 90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:50,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/246701737f3842349b73780a5d46b23d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/246701737f3842349b73780a5d46b23d 2023-11-15 19:53:50,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/12e3d0a8bbdb4eca8fde4910ff41f1f6 2023-11-15 19:53:50,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-15 19:53:50,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:53:50,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/719b157c11224c20be1da739943d865b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/719b157c11224c20be1da739943d865b 2023-11-15 19:53:50,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:50,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6fada62bc2e343d385ace1bf43cb65ca to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__26hfh8opvqunr4bgua04kutsg9m38u8nmvbdbpm0f6om6u2hukj4gtqnrf9u2q1j/family1/6fada62bc2e343d385ace1bf43cb65ca 2023-11-15 19:53:50,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/9bd5a24f6a1647a8abf18ed52713f4f5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/9bd5a24f6a1647a8abf18ed52713f4f5 2023-11-15 19:53:50,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/3580aebde904409282041db7de262252 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/3580aebde904409282041db7de262252 2023-11-15 19:53:50,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__26hfh8opvqunr4bgua04kutsg9m38u8nmvbdbpm0f6om6u2hukj4gtqnrf9u2q1j/family1/6fada62bc2e343d385ace1bf43cb65ca as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_ 2023-11-15 19:53:50,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__26hfh8opvqunr4bgua04kutsg9m38u8nmvbdbpm0f6om6u2hukj4gtqnrf9u2q1j/family1/6fada62bc2e343d385ace1bf43cb65ca into 90ca860037191a24937594b3f2e23821/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_ - updating store file list. 2023-11-15 19:53:50,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/a62e00f177144ec09844439af186982a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/a62e00f177144ec09844439af186982a 2023-11-15 19:53:50,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/d9ac8ac742e84882b1e4ffac19b8cc7b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/d9ac8ac742e84882b1e4ffac19b8cc7b 2023-11-15 19:53:50,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/f3d88d6854d24484ac8899e3a7c47a6e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/f3d88d6854d24484ac8899e3a7c47a6e 2023-11-15 19:53:50,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/06960259873d4babb4d40caef44db3cc_SeqId_44_ 2023-11-15 19:53:50,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_ into 90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:50,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__26hfh8opvqunr4bgua04kutsg9m38u8nmvbdbpm0f6om6u2hukj4gtqnrf9u2q1j/family1/6fada62bc2e343d385ace1bf43cb65ca into 90ca860037191a24937594b3f2e23821/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_) 2023-11-15 19:53:50,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__26hfh8opvqunr4bgua04kutsg9m38u8nmvbdbpm0f6om6u2hukj4gtqnrf9u2q1j/family1/6fada62bc2e343d385ace1bf43cb65ca 2023-11-15 19:53:50,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-15 19:53:50,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-15 19:53:50,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 90ca860037191a24937594b3f2e23821/family1 is initiating minor compaction (all files) 2023-11-15 19:53:50,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6db3d919; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:50,570 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 90ca860037191a24937594b3f2e23821/family1 in testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:53:50,570 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/44e7c297a72845389fa941856ff367e6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/10cc428dda804c4e97306d4a7154709b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp, totalSize=178.1 K 2023-11-15 19:53:50,571 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 44e7c297a72845389fa941856ff367e6, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826299 2023-11-15 19:53:50,571 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 10cc428dda804c4e97306d4a7154709b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226299 2023-11-15 19:53:50,576 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 8195d161a53d4b7187502725a3d647fd_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965226299 2023-11-15 19:53:50,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:50,577 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:50,580 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a50377170d65450faec2c16cf85155e4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a50377170d65450faec2c16cf85155e4 2023-11-15 19:53:50,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512055adb87841d51428d96d549964262f70f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512055adb87841d51428d96d549964262f70f 2023-11-15 19:53:50,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512283fb0a739f910464ba6aa45e107e2e83a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512283fb0a739f910464ba6aa45e107e2e83a 2023-11-15 19:53:50,586 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e00118ec3d0a4d2d8160fadb7dfcda08 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e00118ec3d0a4d2d8160fadb7dfcda08 2023-11-15 19:53:50,586 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-15 19:53:50,587 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-15 19:53:50,587 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:50,587 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:50,648 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 90ca860037191a24937594b3f2e23821#family1#compaction#23 average throughput is 3.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:53:51,122 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/.tmp/family1/4342f58a1d774d04bd1a0785ef21f7e5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/4342f58a1d774d04bd1a0785ef21f7e5 2023-11-15 19:53:51,128 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 90ca860037191a24937594b3f2e23821/family1 of 90ca860037191a24937594b3f2e23821 into 4342f58a1d774d04bd1a0785ef21f7e5(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:53:51,128 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:51,128 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700078030570; duration=0sec 2023-11-15 19:53:51,128 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:53:51,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/44e7c297a72845389fa941856ff367e6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/10cc428dda804c4e97306d4a7154709b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_] to archive 2023-11-15 19:53:51,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:51,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/44e7c297a72845389fa941856ff367e6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/44e7c297a72845389fa941856ff367e6 2023-11-15 19:53:51,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/10cc428dda804c4e97306d4a7154709b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/10cc428dda804c4e97306d4a7154709b 2023-11-15 19:53:51,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/8195d161a53d4b7187502725a3d647fd_SeqId_47_ 2023-11-15 19:53:51,518 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130fd035b65f8fa42b580e2de00dbd293c1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130fd035b65f8fa42b580e2de00dbd293c1 2023-11-15 19:53:51,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:51,543 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/301161bf3b6847b3aa42156c106a799f first=Optional[r00] last=Optional[r8] 2023-11-15 19:53:51,544 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/301161bf3b6847b3aa42156c106a799f}] 2023-11-15 19:53:51,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/301161bf3b6847b3aa42156c106a799f for inclusion in 90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:51,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-15 19:53:51,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:53:51,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:53:51,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/301161bf3b6847b3aa42156c106a799f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1pf4op6fkq7n6pma5p4cbek7hlqejmei0du76vq9g8vtq4tidcpe9q2s7ok9rrk7/family1/301161bf3b6847b3aa42156c106a799f 2023-11-15 19:53:51,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1pf4op6fkq7n6pma5p4cbek7hlqejmei0du76vq9g8vtq4tidcpe9q2s7ok9rrk7/family1/301161bf3b6847b3aa42156c106a799f as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/b22143a455a64cf0a19eda347408113c_SeqId_50_ 2023-11-15 19:53:51,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1pf4op6fkq7n6pma5p4cbek7hlqejmei0du76vq9g8vtq4tidcpe9q2s7ok9rrk7/family1/301161bf3b6847b3aa42156c106a799f into 90ca860037191a24937594b3f2e23821/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/b22143a455a64cf0a19eda347408113c_SeqId_50_ - updating store file list. 2023-11-15 19:53:51,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/b22143a455a64cf0a19eda347408113c_SeqId_50_ into 90ca860037191a24937594b3f2e23821/family1 2023-11-15 19:53:51,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1pf4op6fkq7n6pma5p4cbek7hlqejmei0du76vq9g8vtq4tidcpe9q2s7ok9rrk7/family1/301161bf3b6847b3aa42156c106a799f into 90ca860037191a24937594b3f2e23821/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/family1/b22143a455a64cf0a19eda347408113c_SeqId_50_) 2023-11-15 19:53:51,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1pf4op6fkq7n6pma5p4cbek7hlqejmei0du76vq9g8vtq4tidcpe9q2s7ok9rrk7/family1/301161bf3b6847b3aa42156c106a799f 2023-11-15 19:53:51,560 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:51,561 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:53:51,563 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120858a06f19e224654b2f1eaea267310d9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120858a06f19e224654b2f1eaea267310d9 2023-11-15 19:53:51,564 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c598c5694b0c484fb189672fc105db5e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c598c5694b0c484fb189672fc105db5e 2023-11-15 19:53:51,566 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130897e3e6effd8418283f19548e093ddb5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130897e3e6effd8418283f19548e093ddb5 2023-11-15 19:53:51,566 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-15 19:53:51,566 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-15 19:53:51,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:51,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:51,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:53:51,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:53:51,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:53:51,568 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:53:51,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.8230 sec 2023-11-15 19:53:51,700 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=257 (was 257), OpenFileDescriptor=637 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=238 (was 282), ProcessCount=171 (was 171), AvailableMemoryMB=1197 (was 1326) 2023-11-15 19:53:51,715 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=238, ProcessCount=171, AvailableMemoryMB=1196 2023-11-15 19:53:51,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-15 19:53:51,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:51,721 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:53:51,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-15 19:53:51,722 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:53:51,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-15 19:53:51,724 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:51,725 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b empty. 2023-11-15 19:53:51,726 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:51,726 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-15 19:53:51,738 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-15 19:53:51,744 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c23c324471d392504a9df8aaa65154b, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:53:51,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-15 19:53:52,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-15 19:53:52,152 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:52,152 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 9c23c324471d392504a9df8aaa65154b, disabling compactions & flushes 2023-11-15 19:53:52,152 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,153 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,153 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. after waiting 0 ms 2023-11-15 19:53:52,153 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,153 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,153 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:52,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:53:52,156 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700078032156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078032156"}]},"ts":"1700078032156"} 2023-11-15 19:53:52,158 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:53:52,159 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:53:52,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078032159"}]},"ts":"1700078032159"} 2023-11-15 19:53:52,160 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-15 19:53:52,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=9c23c324471d392504a9df8aaa65154b, ASSIGN}] 2023-11-15 19:53:52,165 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=9c23c324471d392504a9df8aaa65154b, ASSIGN 2023-11-15 19:53:52,166 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=9c23c324471d392504a9df8aaa65154b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:53:52,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=9c23c324471d392504a9df8aaa65154b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:52,317 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700078032317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078032317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078032317"}]},"ts":"1700078032317"} 2023-11-15 19:53:52,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 9c23c324471d392504a9df8aaa65154b, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:53:52,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-15 19:53:52,471 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:52,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c23c324471d392504a9df8aaa65154b, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:53:52,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:52,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:53:52,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:52,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:52,476 INFO [StoreOpener-9c23c324471d392504a9df8aaa65154b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:52,478 DEBUG [StoreOpener-9c23c324471d392504a9df8aaa65154b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1 2023-11-15 19:53:52,478 DEBUG [StoreOpener-9c23c324471d392504a9df8aaa65154b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1 2023-11-15 19:53:52,478 INFO [StoreOpener-9c23c324471d392504a9df8aaa65154b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c23c324471d392504a9df8aaa65154b columnFamilyName family1 2023-11-15 19:53:52,480 INFO [StoreOpener-9c23c324471d392504a9df8aaa65154b-1] regionserver.HStore(310): Store=9c23c324471d392504a9df8aaa65154b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:53:52,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:52,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:52,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c23c324471d392504a9df8aaa65154b 2023-11-15 19:53:52,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:53:52,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c23c324471d392504a9df8aaa65154b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71982206, jitterRate=0.07261845469474792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:53:52,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:52,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b., pid=25, masterSystemTime=1700078032471 2023-11-15 19:53:52,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,490 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=9c23c324471d392504a9df8aaa65154b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:52,490 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700078032490"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078032490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078032490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078032490"}]},"ts":"1700078032490"} 2023-11-15 19:53:52,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-15 19:53:52,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 9c23c324471d392504a9df8aaa65154b, server=jenkins-hbase4.apache.org,42249,1700078002491 in 172 msec 2023-11-15 19:53:52,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-15 19:53:52,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=9c23c324471d392504a9df8aaa65154b, ASSIGN in 330 msec 2023-11-15 19:53:52,495 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:53:52,496 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078032496"}]},"ts":"1700078032496"} 2023-11-15 19:53:52,497 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-15 19:53:52,500 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:53:52,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 782 msec 2023-11-15 19:53:52,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-15 19:53:52,829 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-15 19:53:52,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:52,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,859 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:52,859 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:52,859 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:52,859 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:52,859 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,859 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,861 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:52,861 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:52,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:52,861 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:52,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,862 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:52,863 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:52,863 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:52,864 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-15 19:53:52,886 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a2489a6401904ca9ac76e9c79030550d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130a2489a6401904ca9ac76e9c79030550d 2023-11-15 19:53:53,290 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/ddedfb6b63424282bc48ab02661fc005 2023-11-15 19:53:53,297 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/ddedfb6b63424282bc48ab02661fc005 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/ddedfb6b63424282bc48ab02661fc005 2023-11-15 19:53:53,303 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/ddedfb6b63424282bc48ab02661fc005, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-15 19:53:53,304 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 440ms, sequenceid=5, compaction requested=false 2023-11-15 19:53:53,304 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:53,305 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:53,305 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:53:53,305 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:53:53,307 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,307 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:53,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:53,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:53:53,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9b42ed[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:53,311 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:53,311 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,312 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,313 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:53,313 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:53:53,313 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:53,313 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,313 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:53:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:53:53,315 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:53,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:53,320 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:53:53,320 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:53,320 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:53,320 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,320 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:53,323 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,323 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:53,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,323 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:53,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:53,324 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:53,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,326 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,329 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,329 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,329 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:53,330 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:53,329 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,330 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,330 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,330 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,330 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:53,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:53,330 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:53,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:53,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:53,330 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:53,331 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:53,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:53,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:53,431 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:53,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:53,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:53,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:53,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,438 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:53,438 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:53,438 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:53,438 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:53,439 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,439 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,440 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:53,440 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:53,441 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:53,441 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,441 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,442 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:53:53,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:53,442 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:53,442 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:53,442 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:53,442 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:53,442 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:53,442 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:53,442 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:53,442 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-15 19:53:53,856 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286c16f1f6f03141ae9add127fc1ad1f51 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511286c16f1f6f03141ae9add127fc1ad1f51 2023-11-15 19:53:54,262 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/cfd9e0c9f45240769531b3063c5c840c 2023-11-15 19:53:54,269 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/cfd9e0c9f45240769531b3063c5c840c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/cfd9e0c9f45240769531b3063c5c840c 2023-11-15 19:53:54,276 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/cfd9e0c9f45240769531b3063c5c840c, entries=1, sequenceid=9, filesize=5.0 K 2023-11-15 19:53:54,277 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 835ms, sequenceid=9, compaction requested=false 2023-11-15 19:53:54,277 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:54,277 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:54,277 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:54,277 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:54,277 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,277 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:53:54,277 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:53:54,288 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,288 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:54,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:54,289 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,289 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:54,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:53:54,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d486ab4[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:54,290 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:54,290 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,292 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:53:54,292 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:54,292 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,292 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:54,294 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:53:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:54,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:54,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:53:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:54,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:54,297 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:53:54,297 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:54,297 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:54,297 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,297 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:54,299 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,299 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:54,299 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:54,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:54,300 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,301 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:54,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:54,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,305 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:54,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:54,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:54,305 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,306 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:54,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:54,406 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:54,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:54,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:54,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:54,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,413 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:54,413 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:54,413 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:54,413 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:54,414 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,414 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,416 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,416 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:54,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:54,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:54,416 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:54,416 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:54,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,417 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,417 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:53:54,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:54,417 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:54,417 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:54,417 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:54,418 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:54,418 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:54,418 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:54,418 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:54,418 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:54,832 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d79e4012a78647cbaebf2547a3faa823 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201d79e4012a78647cbaebf2547a3faa823 2023-11-15 19:53:55,244 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/406aa25be0b94e548ca71e3caa4462a9 2023-11-15 19:53:55,259 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/406aa25be0b94e548ca71e3caa4462a9 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/406aa25be0b94e548ca71e3caa4462a9 2023-11-15 19:53:55,264 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/406aa25be0b94e548ca71e3caa4462a9, entries=1, sequenceid=13, filesize=4.9 K 2023-11-15 19:53:55,266 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 848ms, sequenceid=13, compaction requested=true 2023-11-15 19:53:55,266 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:55,266 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:55,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:55,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:55,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:53:55,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:53:55,268 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,268 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:55,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:55,269 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,269 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:55,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:55,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:55,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:53:55,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53e5323f[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:55,271 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:55,271 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,273 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:53:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:55,274 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,274 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:53:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:53:55,275 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:55,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:55,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:55,279 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:53:55,279 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:55,279 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:55,279 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,279 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:55,282 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,282 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,282 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:55,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:55,282 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,284 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,286 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,286 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,286 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:55,286 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:55,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:55,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:55,288 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,288 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:55,288 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:55,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:55,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-15 19:53:55,288 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,289 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,289 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,289 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:55,289 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:55,389 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:55,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:55,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:55,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:55,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,397 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:55,397 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:55,397 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:55,397 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:55,397 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,398 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,399 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,399 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:55,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,400 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:55,400 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:55,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:55,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,401 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,401 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:53:55,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:55,401 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:55,401 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:55,402 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:55,816 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e3a58a33485445da95ea399dfe272c29 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e3a58a33485445da95ea399dfe272c29 2023-11-15 19:53:56,222 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/1aa18fed39ea4045bd07127641a94095 2023-11-15 19:53:56,228 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/1aa18fed39ea4045bd07127641a94095 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1aa18fed39ea4045bd07127641a94095 2023-11-15 19:53:56,233 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1aa18fed39ea4045bd07127641a94095, entries=1, sequenceid=17, filesize=4.9 K 2023-11-15 19:53:56,234 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 832ms, sequenceid=17, compaction requested=true 2023-11-15 19:53:56,234 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:56,234 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:53:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:53:56,236 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,236 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:56,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:56,237 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,237 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:56,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:56,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@dbcc030[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:56,240 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:56,241 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,243 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,243 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:56,243 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:53:56,243 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:56,244 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,244 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:56,245 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,245 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:53:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:56,245 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:56,245 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:53:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:56,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:56,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:56,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:56,248 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:53:56,248 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:56,248 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:56,248 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,248 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:56,249 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,249 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:56,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,249 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:56,250 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,251 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,260 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,260 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,260 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:56,260 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:56,260 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:56,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:56,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:56,260 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:56,260 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,261 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,261 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:56,261 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:56,261 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:56,261 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,361 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:56,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:56,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:56,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:56,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,368 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:56,368 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:56,368 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:56,368 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:56,368 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,369 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,370 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,370 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:56,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:56,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:56,370 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:56,370 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,371 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,372 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:53:56,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:56,372 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:56,372 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:56,372 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:56,786 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f3001d990eed4e45b7a1286c71adf2f5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f3001d990eed4e45b7a1286c71adf2f5 2023-11-15 19:53:57,193 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/1c3e53a256a54278b8c4d8d900a9d847 2023-11-15 19:53:57,198 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/1c3e53a256a54278b8c4d8d900a9d847 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1c3e53a256a54278b8c4d8d900a9d847 2023-11-15 19:53:57,203 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1c3e53a256a54278b8c4d8d900a9d847, entries=1, sequenceid=21, filesize=4.9 K 2023-11-15 19:53:57,204 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 832ms, sequenceid=21, compaction requested=true 2023-11-15 19:53:57,205 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:57,205 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:53:57,205 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:53:57,207 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,207 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:57,208 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,208 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:57,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:53:57,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a577740[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:57,210 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:57,210 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,211 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:57,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:53:57,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:57,211 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,211 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:57,214 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:53:57,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:57,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:57,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:53:57,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:57,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:57,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:57,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:57,217 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:53:57,217 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:57,217 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:57,217 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,217 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:57,219 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,219 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:57,219 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:57,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:57,219 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,221 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:57,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,224 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:57,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:57,224 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,225 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:57,325 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:57,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:57,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:57,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:57,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,331 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:57,331 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:57,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:57,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:57,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,332 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,333 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:57,333 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:57,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:57,334 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:57,334 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:57,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,335 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:53:57,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:57,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:57,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:57,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:57,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:57,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:57,335 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:57,335 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:57,335 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:57,749 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316b6215327a88470fbcb958b7ea8c37ea to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316b6215327a88470fbcb958b7ea8c37ea 2023-11-15 19:53:58,011 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:53:58,155 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/7a6b2872e1b049c8996559d44a1e2222 2023-11-15 19:53:58,160 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/7a6b2872e1b049c8996559d44a1e2222 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/7a6b2872e1b049c8996559d44a1e2222 2023-11-15 19:53:58,165 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/7a6b2872e1b049c8996559d44a1e2222, entries=1, sequenceid=25, filesize=4.9 K 2023-11-15 19:53:58,166 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 831ms, sequenceid=25, compaction requested=true 2023-11-15 19:53:58,166 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:58,166 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:53:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:53:58,168 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,168 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:58,169 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,169 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3494bd74[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:58,170 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:58,170 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,171 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,171 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:53:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:58,172 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,172 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:58,173 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,173 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:58,173 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:58,173 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:58,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:58,175 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:53:58,176 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:58,176 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:58,176 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,176 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:58,178 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,178 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:58,178 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:58,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:58,179 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,180 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:58,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,183 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:58,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:58,183 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:58,184 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:58,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:58,284 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:58,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:58,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:58,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:58,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,290 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:58,290 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:58,290 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:58,290 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:58,291 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,291 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,292 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:58,292 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:58,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:58,292 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:58,293 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:58,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:58,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,293 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:53:58,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:58,294 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:58,294 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:58,294 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:58,294 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:58,708 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101399c780dd0ad4098900527670b5626f4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101399c780dd0ad4098900527670b5626f4 2023-11-15 19:53:59,114 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/10d0b3d7e90d47ababdfe203853b1982 2023-11-15 19:53:59,120 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/10d0b3d7e90d47ababdfe203853b1982 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/10d0b3d7e90d47ababdfe203853b1982 2023-11-15 19:53:59,124 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/10d0b3d7e90d47ababdfe203853b1982, entries=1, sequenceid=29, filesize=4.9 K 2023-11-15 19:53:59,125 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 831ms, sequenceid=29, compaction requested=true 2023-11-15 19:53:59,125 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:53:59,125 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:53:59,126 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:53:59,126 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,126 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:53:59,126 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:53:59,127 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,127 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:59,128 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,128 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:59,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:53:59,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e9a0513[Count = 0] remaining members to acquire global barrier 2023-11-15 19:53:59,129 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:53:59,129 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,132 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:53:59,132 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,132 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:53:59,133 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,133 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:59,134 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:59,134 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:53:59,136 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:53:59,136 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:53:59,136 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:53:59,136 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,136 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:53:59,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,141 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:53:59,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:59,141 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:53:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,142 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:53:59,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:59,146 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:53:59,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:59,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:53:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:53:59,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:53:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:53:59,146 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:53:59,247 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:53:59,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:53:59,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:53:59,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:53:59,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,253 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:53:59,253 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:59,253 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:53:59,253 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:53:59,254 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,254 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,255 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,255 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:53:59,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:53:59,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:53:59,255 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:53:59,255 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:53:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:53:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:53:59,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:53:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:53:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:53:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:53:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:53:59,257 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:53:59,257 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:53:59,257 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:53:59,257 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:53:59,670 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010385714377ab1d4fd292b67c48e500b3bb to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010385714377ab1d4fd292b67c48e500b3bb 2023-11-15 19:54:00,076 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/49e7653495e2450dbd13e5bd0ddc3092 2023-11-15 19:54:00,082 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/49e7653495e2450dbd13e5bd0ddc3092 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/49e7653495e2450dbd13e5bd0ddc3092 2023-11-15 19:54:00,087 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/49e7653495e2450dbd13e5bd0ddc3092, entries=1, sequenceid=33, filesize=4.9 K 2023-11-15 19:54:00,087 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 830ms, sequenceid=33, compaction requested=true 2023-11-15 19:54:00,088 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:54:00,088 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:54:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,090 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:00,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:00,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@254cf1b0[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:00,092 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:00,092 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,094 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,094 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:00,094 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:00,094 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:00,094 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,094 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:00,096 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,096 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:00,096 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:00,097 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:00,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:00,099 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:00,099 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:00,099 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:00,099 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,099 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:00,100 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,100 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:00,100 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:00,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:00,101 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:00,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,102 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:00,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:00,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:54:00,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:00,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:00,105 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:00,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:00,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:00,105 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,106 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,106 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,206 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:00,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:00,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:00,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:00,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,213 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:54:00,213 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:00,213 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:00,213 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:00,213 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,213 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,214 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:00,214 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:00,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:00,215 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:00,215 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:00,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:00,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,216 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,216 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:00,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:00,216 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:00,216 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:00,216 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:00,216 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:00,216 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:00,216 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:54:00,216 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:54:00,216 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:00,630 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907968f4e5b0c5649cdb9cf334b772ca5ee to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907968f4e5b0c5649cdb9cf334b772ca5ee 2023-11-15 19:54:01,036 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/79305d677c2c4c7c8f8c4e9d578b1edb 2023-11-15 19:54:01,041 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/79305d677c2c4c7c8f8c4e9d578b1edb as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/79305d677c2c4c7c8f8c4e9d578b1edb 2023-11-15 19:54:01,046 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/79305d677c2c4c7c8f8c4e9d578b1edb, entries=1, sequenceid=37, filesize=4.9 K 2023-11-15 19:54:01,046 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 830ms, sequenceid=37, compaction requested=true 2023-11-15 19:54:01,047 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:54:01,047 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:54:01,047 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:01,047 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:01,047 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,047 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:01,047 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:01,050 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,050 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:01,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:01,050 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:01,050 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:01,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f06f2e[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:01,051 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:01,051 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,052 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:01,053 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,053 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:01,054 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,054 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:01,054 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:01,054 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:01,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:01,057 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:01,057 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:01,057 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:01,057 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,057 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:01,059 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,059 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:01,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:01,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,059 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:01,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:01,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:01,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:01,059 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,061 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:01,064 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:01,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:01,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:54:01,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,064 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,065 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:01,065 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:01,065 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:01,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:01,165 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:01,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:01,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:01,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:01,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,171 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:54:01,171 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:01,171 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:01,171 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:01,172 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,172 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,173 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:01,173 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:01,173 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:01,173 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:01,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,174 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,174 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:01,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:01,175 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:01,175 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:01,175 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:01,175 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:01,175 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:01,175 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:54:01,175 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. started... 2023-11-15 19:54:01,175 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9c23c324471d392504a9df8aaa65154b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:01,587 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201e8054ea2dca4ca2b03d479dc0939ab2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511201e8054ea2dca4ca2b03d479dc0939ab2 2023-11-15 19:54:01,993 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/c1966b6bcfe9401582fe13fc6715e323 2023-11-15 19:54:01,999 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/c1966b6bcfe9401582fe13fc6715e323 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/c1966b6bcfe9401582fe13fc6715e323 2023-11-15 19:54:02,004 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/c1966b6bcfe9401582fe13fc6715e323, entries=1, sequenceid=41, filesize=4.9 K 2023-11-15 19:54:02,005 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9c23c324471d392504a9df8aaa65154b in 829ms, sequenceid=41, compaction requested=true 2023-11-15 19:54:02,005 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:54:02,005 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:54:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:02,007 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,007 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:02,007 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,007 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:02,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:02,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:02,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:02,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@651e03d9[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:02,009 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:02,009 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,013 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,013 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:02,013 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:02,013 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:02,013 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,013 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:02,014 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,014 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:02,014 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:02,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:02,017 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:02,017 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:02,017 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:02,017 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,017 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:02,018 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,018 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:02,018 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:02,019 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:02,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,020 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:02,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:02,023 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:02,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-15 19:54:02,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:02,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:02,023 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:02,124 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:02,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:02,126 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-15 19:54:02,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:54:02,128 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:54:02,129 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078642129 2023-11-15 19:54:02,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:02,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-15 19:54:02,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-15 19:54:02,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:02,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x4142c576 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:02,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28a85d41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:02,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:02,988 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cdef4be8012146cab1cba8f17f25d03c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdef4be8012146cab1cba8f17f25d03c 2023-11-15 19:54:02,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:03,003 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:03,004 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:03,010 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:03,012 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:03,023 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 first=Optional[r3] last=Optional[r6] 2023-11-15 19:54:03,024 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5}] 2023-11-15 19:54:03,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 for inclusion in 9c23c324471d392504a9df8aaa65154b/family1 2023-11-15 19:54:03,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-15 19:54:03,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:03,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:54:03,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5or3luopbv1tdqj6ioicn7ib0ic1flpio633q3stfjjdjkehpb7uhoq4neqpga98/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 2023-11-15 19:54:03,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5or3luopbv1tdqj6ioicn7ib0ic1flpio633q3stfjjdjkehpb7uhoq4neqpga98/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_ 2023-11-15 19:54:03,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5or3luopbv1tdqj6ioicn7ib0ic1flpio633q3stfjjdjkehpb7uhoq4neqpga98/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 into 9c23c324471d392504a9df8aaa65154b/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_ - updating store file list. 2023-11-15 19:54:03,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_ into 9c23c324471d392504a9df8aaa65154b/family1 2023-11-15 19:54:03,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5or3luopbv1tdqj6ioicn7ib0ic1flpio633q3stfjjdjkehpb7uhoq4neqpga98/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 into 9c23c324471d392504a9df8aaa65154b/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_) 2023-11-15 19:54:03,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5or3luopbv1tdqj6ioicn7ib0ic1flpio633q3stfjjdjkehpb7uhoq4neqpga98/family1/9cad96f9ff0f439ebeaa9ee66a77e5f5 2023-11-15 19:54:03,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-15 19:54:03,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-15 19:54:03,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 9c23c324471d392504a9df8aaa65154b/family1 is initiating minor compaction 2023-11-15 19:54:03,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d365026; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:03,043 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9c23c324471d392504a9df8aaa65154b/family1 in testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:54:03,044 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/cfd9e0c9f45240769531b3063c5c840c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/406aa25be0b94e548ca71e3caa4462a9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1aa18fed39ea4045bd07127641a94095, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1c3e53a256a54278b8c4d8d900a9d847, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/7a6b2872e1b049c8996559d44a1e2222, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/10d0b3d7e90d47ababdfe203853b1982, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/49e7653495e2450dbd13e5bd0ddc3092, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/79305d677c2c4c7c8f8c4e9d578b1edb, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/c1966b6bcfe9401582fe13fc6715e323, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp, totalSize=50.0 K 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting cfd9e0c9f45240769531b3063c5c840c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 406aa25be0b94e548ca71e3caa4462a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 1aa18fed39ea4045bd07127641a94095, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 1c3e53a256a54278b8c4d8d900a9d847, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 7a6b2872e1b049c8996559d44a1e2222, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 10d0b3d7e90d47ababdfe203853b1982, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 49e7653495e2450dbd13e5bd0ddc3092, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 79305d677c2c4c7c8f8c4e9d578b1edb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting c1966b6bcfe9401582fe13fc6715e323, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-15 19:54:03,044 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting f539c872e23849229a06ff07bfca7455_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-15 19:54:03,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:03,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:03,048 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f3001d990eed4e45b7a1286c71adf2f5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f3001d990eed4e45b7a1286c71adf2f5 2023-11-15 19:54:03,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316b6215327a88470fbcb958b7ea8c37ea to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316b6215327a88470fbcb958b7ea8c37ea 2023-11-15 19:54:03,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101399c780dd0ad4098900527670b5626f4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101399c780dd0ad4098900527670b5626f4 2023-11-15 19:54:03,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010385714377ab1d4fd292b67c48e500b3bb to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010385714377ab1d4fd292b67c48e500b3bb 2023-11-15 19:54:03,054 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-15 19:54:03,054 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-15 19:54:03,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,080 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9c23c324471d392504a9df8aaa65154b#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:03,495 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fa9a2087b06d47d49905db74275d60b5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205fa9a2087b06d47d49905db74275d60b5 2023-11-15 19:54:03,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:03,522 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eb964ef13ecd4390aa37d48ba9de0825 first=Optional[r1] last=Optional[r2] 2023-11-15 19:54:03,523 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eb964ef13ecd4390aa37d48ba9de0825}] 2023-11-15 19:54:03,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eb964ef13ecd4390aa37d48ba9de0825 for inclusion in 9c23c324471d392504a9df8aaa65154b/family1 2023-11-15 19:54:03,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-15 19:54:03,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:03,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:54:03,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eb964ef13ecd4390aa37d48ba9de0825 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3j05v1h75pogar7ho64j7j2ngvtf9cnkchtg6t4amh7aafp8esvev1eglf1pqb3b/family1/eb964ef13ecd4390aa37d48ba9de0825 2023-11-15 19:54:03,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3j05v1h75pogar7ho64j7j2ngvtf9cnkchtg6t4amh7aafp8esvev1eglf1pqb3b/family1/eb964ef13ecd4390aa37d48ba9de0825 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f75eb32275c04b11b01154655c6de9e1_SeqId_46_ 2023-11-15 19:54:03,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3j05v1h75pogar7ho64j7j2ngvtf9cnkchtg6t4amh7aafp8esvev1eglf1pqb3b/family1/eb964ef13ecd4390aa37d48ba9de0825 into 9c23c324471d392504a9df8aaa65154b/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f75eb32275c04b11b01154655c6de9e1_SeqId_46_ - updating store file list. 2023-11-15 19:54:03,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f75eb32275c04b11b01154655c6de9e1_SeqId_46_ into 9c23c324471d392504a9df8aaa65154b/family1 2023-11-15 19:54:03,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3j05v1h75pogar7ho64j7j2ngvtf9cnkchtg6t4amh7aafp8esvev1eglf1pqb3b/family1/eb964ef13ecd4390aa37d48ba9de0825 into 9c23c324471d392504a9df8aaa65154b/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f75eb32275c04b11b01154655c6de9e1_SeqId_46_) 2023-11-15 19:54:03,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3j05v1h75pogar7ho64j7j2ngvtf9cnkchtg6t4amh7aafp8esvev1eglf1pqb3b/family1/eb964ef13ecd4390aa37d48ba9de0825 2023-11-15 19:54:03,540 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:03,540 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:03,542 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201d79e4012a78647cbaebf2547a3faa823 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201d79e4012a78647cbaebf2547a3faa823 2023-11-15 19:54:03,543 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e3a58a33485445da95ea399dfe272c29 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e3a58a33485445da95ea399dfe272c29 2023-11-15 19:54:03,543 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-15 19:54:03,543 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-15 19:54:03,544 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:03,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:03,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:03,545 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:54:03,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4180 sec 2023-11-15 19:54:03,651 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 257) - Thread LEAK? -, OpenFileDescriptor=653 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 238), ProcessCount=171 (was 171), AvailableMemoryMB=1018 (was 1196) 2023-11-15 19:54:03,663 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=233, ProcessCount=171, AvailableMemoryMB=1017 2023-11-15 19:54:03,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-15 19:54:03,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:03,667 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:54:03,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-15 19:54:03,668 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:54:03,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-15 19:54:03,670 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:03,670 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539 2023-11-15 19:54:03,670 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:03,671 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae empty. 2023-11-15 19:54:03,671 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539 empty. 2023-11-15 19:54:03,671 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63 empty. 2023-11-15 19:54:03,671 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:03,671 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539 2023-11-15 19:54:03,671 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:03,671 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-15 19:54:03,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-15 19:54:03,898 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/.tmp/family1/7904309c04da4e64a05c2e840d8cba6a as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/7904309c04da4e64a05c2e840d8cba6a 2023-11-15 19:54:03,903 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9c23c324471d392504a9df8aaa65154b/family1 of 9c23c324471d392504a9df8aaa65154b into 7904309c04da4e64a05c2e840d8cba6a(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:54:03,903 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:54:03,904 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700078043043; duration=0sec 2023-11-15 19:54:03,904 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:03,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/cfd9e0c9f45240769531b3063c5c840c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/406aa25be0b94e548ca71e3caa4462a9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1aa18fed39ea4045bd07127641a94095, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1c3e53a256a54278b8c4d8d900a9d847, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/7a6b2872e1b049c8996559d44a1e2222, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/10d0b3d7e90d47ababdfe203853b1982, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/49e7653495e2450dbd13e5bd0ddc3092, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/79305d677c2c4c7c8f8c4e9d578b1edb, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/c1966b6bcfe9401582fe13fc6715e323, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_] to archive 2023-11-15 19:54:03,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:03,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/cfd9e0c9f45240769531b3063c5c840c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/cfd9e0c9f45240769531b3063c5c840c 2023-11-15 19:54:03,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/406aa25be0b94e548ca71e3caa4462a9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/406aa25be0b94e548ca71e3caa4462a9 2023-11-15 19:54:03,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1aa18fed39ea4045bd07127641a94095 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1aa18fed39ea4045bd07127641a94095 2023-11-15 19:54:03,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1c3e53a256a54278b8c4d8d900a9d847 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/1c3e53a256a54278b8c4d8d900a9d847 2023-11-15 19:54:03,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/7a6b2872e1b049c8996559d44a1e2222 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/7a6b2872e1b049c8996559d44a1e2222 2023-11-15 19:54:03,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/10d0b3d7e90d47ababdfe203853b1982 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/10d0b3d7e90d47ababdfe203853b1982 2023-11-15 19:54:03,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/49e7653495e2450dbd13e5bd0ddc3092 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/49e7653495e2450dbd13e5bd0ddc3092 2023-11-15 19:54:03,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/79305d677c2c4c7c8f8c4e9d578b1edb to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/79305d677c2c4c7c8f8c4e9d578b1edb 2023-11-15 19:54:03,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/c1966b6bcfe9401582fe13fc6715e323 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/c1966b6bcfe9401582fe13fc6715e323 2023-11-15 19:54:03,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/family1/f539c872e23849229a06ff07bfca7455_SeqId_44_ 2023-11-15 19:54:03,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-15 19:54:04,080 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-15 19:54:04,081 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 19f0cc58719014d965ff84559b0ced63, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:54:04,082 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 345bd17971f9f52467e4027968d08539, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:54:04,082 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => b338a0c4aca40823c5a393a0804e31ae, NAME => 'testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:54:04,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-15 19:54:04,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:04,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 345bd17971f9f52467e4027968d08539, disabling compactions & flushes 2023-11-15 19:54:04,490 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:04,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:04,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. after waiting 0 ms 2023-11-15 19:54:04,490 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:04,491 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 345bd17971f9f52467e4027968d08539: 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 19f0cc58719014d965ff84559b0ced63, disabling compactions & flushes 2023-11-15 19:54:04,491 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. after waiting 0 ms 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:04,491 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 19f0cc58719014d965ff84559b0ced63: 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing b338a0c4aca40823c5a393a0804e31ae, disabling compactions & flushes 2023-11-15 19:54:04,491 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:04,491 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:04,492 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. after waiting 0 ms 2023-11-15 19:54:04,492 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:04,492 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:04,492 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for b338a0c4aca40823c5a393a0804e31ae: 2023-11-15 19:54:04,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:54:04,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700078044495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078044495"}]},"ts":"1700078044495"} 2023-11-15 19:54:04,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700078044495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078044495"}]},"ts":"1700078044495"} 2023-11-15 19:54:04,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700078044495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078044495"}]},"ts":"1700078044495"} 2023-11-15 19:54:04,498 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-15 19:54:04,499 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:54:04,499 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078044499"}]},"ts":"1700078044499"} 2023-11-15 19:54:04,500 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-15 19:54:04,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b338a0c4aca40823c5a393a0804e31ae, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=345bd17971f9f52467e4027968d08539, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f0cc58719014d965ff84559b0ced63, ASSIGN}] 2023-11-15 19:54:04,506 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=345bd17971f9f52467e4027968d08539, ASSIGN 2023-11-15 19:54:04,506 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f0cc58719014d965ff84559b0ced63, ASSIGN 2023-11-15 19:54:04,506 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b338a0c4aca40823c5a393a0804e31ae, ASSIGN 2023-11-15 19:54:04,506 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=345bd17971f9f52467e4027968d08539, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:54:04,507 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f0cc58719014d965ff84559b0ced63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:54:04,507 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b338a0c4aca40823c5a393a0804e31ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:54:04,658 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=19f0cc58719014d965ff84559b0ced63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:04,658 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=345bd17971f9f52467e4027968d08539, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:04,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b338a0c4aca40823c5a393a0804e31ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:04,658 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700078044658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078044658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078044658"}]},"ts":"1700078044658"} 2023-11-15 19:54:04,658 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700078044658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078044658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078044658"}]},"ts":"1700078044658"} 2023-11-15 19:54:04,659 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700078044658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078044658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078044658"}]},"ts":"1700078044658"} 2023-11-15 19:54:04,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 19f0cc58719014d965ff84559b0ced63, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:04,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 345bd17971f9f52467e4027968d08539, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:04,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure b338a0c4aca40823c5a393a0804e31ae, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:04,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-15 19:54:04,812 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:04,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:04,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b338a0c4aca40823c5a393a0804e31ae, NAME => 'testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae.', STARTKEY => '', ENDKEY => '1'} 2023-11-15 19:54:04,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:04,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,817 INFO [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,819 DEBUG [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae/family1 2023-11-15 19:54:04,819 DEBUG [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae/family1 2023-11-15 19:54:04,819 INFO [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b338a0c4aca40823c5a393a0804e31ae columnFamilyName family1 2023-11-15 19:54:04,821 INFO [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] regionserver.HStore(310): Store=b338a0c4aca40823c5a393a0804e31ae/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:04,821 INFO [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,822 DEBUG [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae/family2 2023-11-15 19:54:04,822 DEBUG [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae/family2 2023-11-15 19:54:04,823 INFO [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b338a0c4aca40823c5a393a0804e31ae columnFamilyName family2 2023-11-15 19:54:04,824 INFO [StoreOpener-b338a0c4aca40823c5a393a0804e31ae-1] regionserver.HStore(310): Store=b338a0c4aca40823c5a393a0804e31ae/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:04,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:54:04,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:54:04,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:54:04,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b338a0c4aca40823c5a393a0804e31ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64585810, jitterRate=-0.037596434354782104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:54:04,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b338a0c4aca40823c5a393a0804e31ae: 2023-11-15 19:54:04,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae., pid=33, masterSystemTime=1700078044812 2023-11-15 19:54:04,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:04,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:04,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:04,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 345bd17971f9f52467e4027968d08539, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539.', STARTKEY => '1', ENDKEY => '2'} 2023-11-15 19:54:04,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:04,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b338a0c4aca40823c5a393a0804e31ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:04,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700078044834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078044834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078044834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078044834"}]},"ts":"1700078044834"} 2023-11-15 19:54:04,836 INFO [StoreOpener-345bd17971f9f52467e4027968d08539-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,837 DEBUG [StoreOpener-345bd17971f9f52467e4027968d08539-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539/family1 2023-11-15 19:54:04,837 DEBUG [StoreOpener-345bd17971f9f52467e4027968d08539-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539/family1 2023-11-15 19:54:04,837 INFO [StoreOpener-345bd17971f9f52467e4027968d08539-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 345bd17971f9f52467e4027968d08539 columnFamilyName family1 2023-11-15 19:54:04,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=28 2023-11-15 19:54:04,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure b338a0c4aca40823c5a393a0804e31ae, server=jenkins-hbase4.apache.org,42249,1700078002491 in 174 msec 2023-11-15 19:54:04,838 INFO [StoreOpener-345bd17971f9f52467e4027968d08539-1] regionserver.HStore(310): Store=345bd17971f9f52467e4027968d08539/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:04,839 INFO [StoreOpener-345bd17971f9f52467e4027968d08539-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b338a0c4aca40823c5a393a0804e31ae, ASSIGN in 334 msec 2023-11-15 19:54:04,840 DEBUG [StoreOpener-345bd17971f9f52467e4027968d08539-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539/family2 2023-11-15 19:54:04,840 DEBUG [StoreOpener-345bd17971f9f52467e4027968d08539-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539/family2 2023-11-15 19:54:04,841 INFO [StoreOpener-345bd17971f9f52467e4027968d08539-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 345bd17971f9f52467e4027968d08539 columnFamilyName family2 2023-11-15 19:54:04,842 INFO [StoreOpener-345bd17971f9f52467e4027968d08539-1] regionserver.HStore(310): Store=345bd17971f9f52467e4027968d08539/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:04,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:54:04,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 345bd17971f9f52467e4027968d08539 2023-11-15 19:54:04,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:54:04,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 345bd17971f9f52467e4027968d08539; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70175236, jitterRate=0.045692503452301025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:54:04,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 345bd17971f9f52467e4027968d08539: 2023-11-15 19:54:04,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539., pid=32, masterSystemTime=1700078044812 2023-11-15 19:54:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:04,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:04,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:04,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19f0cc58719014d965ff84559b0ced63, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63.', STARTKEY => '2', ENDKEY => ''} 2023-11-15 19:54:04,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=345bd17971f9f52467e4027968d08539, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:04,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,850 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700078044850"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078044850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078044850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078044850"}]},"ts":"1700078044850"} 2023-11-15 19:54:04,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:04,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,851 INFO [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,852 DEBUG [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1 2023-11-15 19:54:04,852 DEBUG [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1 2023-11-15 19:54:04,853 INFO [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19f0cc58719014d965ff84559b0ced63 columnFamilyName family1 2023-11-15 19:54:04,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=29 2023-11-15 19:54:04,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 345bd17971f9f52467e4027968d08539, server=jenkins-hbase4.apache.org,42249,1700078002491 in 190 msec 2023-11-15 19:54:04,854 INFO [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] regionserver.HStore(310): Store=19f0cc58719014d965ff84559b0ced63/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:04,854 INFO [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=345bd17971f9f52467e4027968d08539, ASSIGN in 349 msec 2023-11-15 19:54:04,855 DEBUG [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family2 2023-11-15 19:54:04,855 DEBUG [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family2 2023-11-15 19:54:04,856 INFO [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19f0cc58719014d965ff84559b0ced63 columnFamilyName family2 2023-11-15 19:54:04,857 INFO [StoreOpener-19f0cc58719014d965ff84559b0ced63-1] regionserver.HStore(310): Store=19f0cc58719014d965ff84559b0ced63/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:04,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:54:04,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19f0cc58719014d965ff84559b0ced63 2023-11-15 19:54:04,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:54:04,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19f0cc58719014d965ff84559b0ced63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64966187, jitterRate=-0.031928375363349915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:54:04,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19f0cc58719014d965ff84559b0ced63: 2023-11-15 19:54:04,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63., pid=31, masterSystemTime=1700078044812 2023-11-15 19:54:04,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:04,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:04,864 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=19f0cc58719014d965ff84559b0ced63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:04,864 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700078044864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078044864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078044864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078044864"}]},"ts":"1700078044864"} 2023-11-15 19:54:04,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=30 2023-11-15 19:54:04,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 19f0cc58719014d965ff84559b0ced63, server=jenkins-hbase4.apache.org,42249,1700078002491 in 206 msec 2023-11-15 19:54:04,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-11-15 19:54:04,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=19f0cc58719014d965ff84559b0ced63, ASSIGN in 363 msec 2023-11-15 19:54:04,869 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:54:04,870 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078044870"}]},"ts":"1700078044870"} 2023-11-15 19:54:04,871 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-15 19:54:04,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:54:04,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2080 sec 2023-11-15 19:54:05,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-15 19:54:05,773 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-15 19:54:05,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:05,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,783 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-15 19:54:05,783 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:05,783 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-15 19:54:05,783 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-15 19:54:05,783 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,784 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,786 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:05,786 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:05,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:05,786 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:05,786 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:05,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:05,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:05,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-15 19:54:05,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:05,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-15 19:54:05,788 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:05,788 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. started... 2023-11-15 19:54:05,788 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:05,788 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. started... 2023-11-15 19:54:05,790 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:54:05,790 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 345bd17971f9f52467e4027968d08539: 2023-11-15 19:54:05,790 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:05,790 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:05,791 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. started... 2023-11-15 19:54:05,790 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b338a0c4aca40823c5a393a0804e31ae: 2023-11-15 19:54:05,791 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 19f0cc58719014d965ff84559b0ced63 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-15 19:54:05,791 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:05,791 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:05,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:54:05,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:54:05,805 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-15 19:54:06,206 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115b1989d7041924a62a0843153324c3a3e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231115b1989d7041924a62a0843153324c3a3e 2023-11-15 19:54:06,611 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/.tmp/family1/89f4f83abd3644e493c8f4553afd8b29 2023-11-15 19:54:06,617 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/.tmp/family1/89f4f83abd3644e493c8f4553afd8b29 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/89f4f83abd3644e493c8f4553afd8b29 2023-11-15 19:54:06,624 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/89f4f83abd3644e493c8f4553afd8b29, entries=1, sequenceid=5, filesize=4.9 K 2023-11-15 19:54:06,625 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 19f0cc58719014d965ff84559b0ced63 in 834ms, sequenceid=5, compaction requested=false 2023-11-15 19:54:06,626 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 19f0cc58719014d965ff84559b0ced63: 2023-11-15 19:54:06,626 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:06,626 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:54:06,626 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:54:06,626 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,626 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-15 19:54:06,626 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-15 19:54:06,628 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,628 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:06,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:06,628 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:06,628 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-15 19:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b3230f4[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:06,630 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-15 19:54:06,630 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,632 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,632 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-15 19:54:06,632 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-15 19:54:06,632 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:06,632 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,632 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:06,635 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:06,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-15 19:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:06,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:06,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-15 19:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:06,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-15 19:54:06,638 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-15 19:54:06,638 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:06,638 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:06,638 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,638 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:06,642 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,642 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,642 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:06,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:06,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:06,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:06,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:06,642 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:06,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,644 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:06,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:06,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:06,647 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:06,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-15 19:54:06,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:06,647 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:06,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:06,648 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:06,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-15 19:54:06,648 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:06,748 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:06,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:06,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:06,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:06,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,755 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-15 19:54:06,755 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:06,755 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-15 19:54:06,755 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-15 19:54:06,755 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,756 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,767 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:06,767 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:06,768 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:06,768 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:06,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,769 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,769 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-15 19:54:06,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:06,769 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-15 19:54:06,769 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:06,769 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-15 19:54:06,769 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:06,769 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. started... 2023-11-15 19:54:06,769 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:06,769 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:06,770 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. started... 2023-11-15 19:54:06,769 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:54:06,770 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 19f0cc58719014d965ff84559b0ced63 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-15 19:54:06,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:06,769 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b338a0c4aca40823c5a393a0804e31ae: 2023-11-15 19:54:06,770 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:54:06,769 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. started... 2023-11-15 19:54:06,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:54:06,770 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 345bd17971f9f52467e4027968d08539: 2023-11-15 19:54:06,770 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:54:06,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:54:07,183 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115a25a02daf1de425185b8ac6b5934ad9d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231115a25a02daf1de425185b8ac6b5934ad9d 2023-11-15 19:54:07,588 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/.tmp/family1/f07722bf5a954852b8349911741ae8e8 2023-11-15 19:54:07,594 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/.tmp/family1/f07722bf5a954852b8349911741ae8e8 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/f07722bf5a954852b8349911741ae8e8 2023-11-15 19:54:07,598 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/f07722bf5a954852b8349911741ae8e8, entries=2, sequenceid=9, filesize=5.0 K 2023-11-15 19:54:07,599 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 19f0cc58719014d965ff84559b0ced63 in 829ms, sequenceid=9, compaction requested=false 2023-11-15 19:54:07,599 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 19f0cc58719014d965ff84559b0ced63: 2023-11-15 19:54:07,599 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:54:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:54:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-15 19:54:07,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-15 19:54:07,601 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,601 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:07,601 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,601 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:07,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-15 19:54:07,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39b18f53[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:07,603 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-15 19:54:07,603 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,605 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-15 19:54:07,605 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-15 19:54:07,605 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:07,605 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,605 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:07,607 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,607 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-15 19:54:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:07,607 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:07,607 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-15 19:54:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:07,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-15 19:54:07,610 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-15 19:54:07,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:07,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:07,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,610 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:07,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:07,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:07,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:07,612 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,613 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:07,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,620 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,620 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:07,620 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:07,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-15 19:54:07,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:07,620 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:07,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:07,620 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:07,620 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,621 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:07,621 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:07,621 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:07,621 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,621 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:07,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:07,621 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,721 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:07,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:07,729 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-15 19:54:07,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-15 19:54:07,731 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-15 19:54:07,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:07,732 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078647732 2023-11-15 19:54:07,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:07,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-15 19:54:07,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-15 19:54:07,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x1a36c369 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:07,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@709ed73b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:07,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231115 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-15 19:54:08,569 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115ccac1ba231e24005a99aa612bdb52522 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231115ccac1ba231e24005a99aa612bdb52522 2023-11-15 19:54:08,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-15 19:54:08,585 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:08,586 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:08,594 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:08,596 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:08,605 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231115/family1/a073abefb8a24243816ab836b14b57e4 first=Optional[k0] last=Optional[k1] 2023-11-15 19:54:08,606 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231115/family1/a073abefb8a24243816ab836b14b57e4}] 2023-11-15 19:54:08,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231115/family1/a073abefb8a24243816ab836b14b57e4 for inclusion in 19f0cc58719014d965ff84559b0ced63/family1 2023-11-15 19:54:08,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-15 19:54:08,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-15 19:54:08,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 19f0cc58719014d965ff84559b0ced63: 2023-11-15 19:54:08,635 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:08,635 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4142c576 to 127.0.0.1:50885 2023-11-15 19:54:08,635 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:08,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231115/family1/a073abefb8a24243816ab836b14b57e4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testScannerOnBulkLoadRefHFiles__tuub2cevjslfaomhnet3ta0k3dp6h8qu65ocv00vsubjsjm8kdtl3rhfru5c304n/family1/a073abefb8a24243816ab836b14b57e4 2023-11-15 19:54:08,636 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:08,636 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a2b3ab5 to 127.0.0.1:50885 2023-11-15 19:54:08,636 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:08,636 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:08,636 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x146262fb to 127.0.0.1:50885 2023-11-15 19:54:08,636 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:08,637 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:08,637 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21650ac2 to 127.0.0.1:50885 2023-11-15 19:54:08,637 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:08,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testScannerOnBulkLoadRefHFiles__tuub2cevjslfaomhnet3ta0k3dp6h8qu65ocv00vsubjsjm8kdtl3rhfru5c304n/family1/a073abefb8a24243816ab836b14b57e4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_ 2023-11-15 19:54:08,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testScannerOnBulkLoadRefHFiles__tuub2cevjslfaomhnet3ta0k3dp6h8qu65ocv00vsubjsjm8kdtl3rhfru5c304n/family1/a073abefb8a24243816ab836b14b57e4 into 19f0cc58719014d965ff84559b0ced63/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_ - updating store file list. 2023-11-15 19:54:08,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_ into 19f0cc58719014d965ff84559b0ced63/family1 2023-11-15 19:54:08,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testScannerOnBulkLoadRefHFiles__tuub2cevjslfaomhnet3ta0k3dp6h8qu65ocv00vsubjsjm8kdtl3rhfru5c304n/family1/a073abefb8a24243816ab836b14b57e4 into 19f0cc58719014d965ff84559b0ced63/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_) 2023-11-15 19:54:08,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testScannerOnBulkLoadRefHFiles__tuub2cevjslfaomhnet3ta0k3dp6h8qu65ocv00vsubjsjm8kdtl3rhfru5c304n/family1/a073abefb8a24243816ab836b14b57e4 2023-11-15 19:54:08,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-15 19:54:08,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-15 19:54:08,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 19f0cc58719014d965ff84559b0ced63/family1 is initiating minor compaction (all files) 2023-11-15 19:54:08,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@450e4a3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:08,648 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 19f0cc58719014d965ff84559b0ced63/family1 in testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:54:08,648 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/89f4f83abd3644e493c8f4553afd8b29, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/f07722bf5a954852b8349911741ae8e8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/.tmp, totalSize=15.1 K 2023-11-15 19:54:08,649 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 89f4f83abd3644e493c8f4553afd8b29, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078045773 2023-11-15 19:54:08,649 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting f07722bf5a954852b8349911741ae8e8, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078045773 2023-11-15 19:54:08,650 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3446aaaf32824d339726204aebbc1eae_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078045773 2023-11-15 19:54:08,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-15 19:54:08,650 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:08,652 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231115a25a02daf1de425185b8ac6b5934ad9d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231115a25a02daf1de425185b8ac6b5934ad9d 2023-11-15 19:54:08,654 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231115b1989d7041924a62a0843153324c3a3e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231115b1989d7041924a62a0843153324c3a3e 2023-11-15 19:54:08,654 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-15 19:54:08,654 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231115' 2023-11-15 19:54:08,654 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231115 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-15 19:54:08,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-15 19:54:08,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:08,655 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-15 19:54:08,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 925 msec 2023-11-15 19:54:08,659 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 19f0cc58719014d965ff84559b0ced63#family1#compaction#37 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:08,694 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260 (was 259) - Thread LEAK? -, OpenFileDescriptor=628 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 233), ProcessCount=173 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=943 (was 1017) 2023-11-15 19:54:08,704 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=214, ProcessCount=173, AvailableMemoryMB=942 2023-11-15 19:54:08,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-15 19:54:08,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:08,708 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:54:08,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-15 19:54:08,709 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:54:08,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-15 19:54:08,710 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:08,710 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5 empty. 2023-11-15 19:54:08,711 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:08,711 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-15 19:54:08,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-15 19:54:09,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-15 19:54:09,120 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-15 19:54:09,121 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4e3041c1c190ff3451901a9a27560aa5, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:54:09,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-15 19:54:09,527 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:09,527 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 4e3041c1c190ff3451901a9a27560aa5, disabling compactions & flushes 2023-11-15 19:54:09,527 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:09,527 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:09,527 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. after waiting 0 ms 2023-11-15 19:54:09,527 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:09,527 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:09,527 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:09,529 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:54:09,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700078049530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078049530"}]},"ts":"1700078049530"} 2023-11-15 19:54:09,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:54:09,532 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:54:09,532 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078049532"}]},"ts":"1700078049532"} 2023-11-15 19:54:09,533 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-15 19:54:09,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4e3041c1c190ff3451901a9a27560aa5, ASSIGN}] 2023-11-15 19:54:09,539 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4e3041c1c190ff3451901a9a27560aa5, ASSIGN 2023-11-15 19:54:09,540 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4e3041c1c190ff3451901a9a27560aa5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:54:09,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4e3041c1c190ff3451901a9a27560aa5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:09,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700078049691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078049691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078049691"}]},"ts":"1700078049691"} 2023-11-15 19:54:09,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 4e3041c1c190ff3451901a9a27560aa5, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:09,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-15 19:54:09,844 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:09,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:09,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e3041c1c190ff3451901a9a27560aa5, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:09,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:09,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:09,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:09,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:09,849 INFO [StoreOpener-4e3041c1c190ff3451901a9a27560aa5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:09,850 DEBUG [StoreOpener-4e3041c1c190ff3451901a9a27560aa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1 2023-11-15 19:54:09,850 DEBUG [StoreOpener-4e3041c1c190ff3451901a9a27560aa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1 2023-11-15 19:54:09,851 INFO [StoreOpener-4e3041c1c190ff3451901a9a27560aa5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e3041c1c190ff3451901a9a27560aa5 columnFamilyName family1 2023-11-15 19:54:09,852 INFO [StoreOpener-4e3041c1c190ff3451901a9a27560aa5-1] regionserver.HStore(310): Store=4e3041c1c190ff3451901a9a27560aa5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:09,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:09,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:09,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:54:09,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:54:09,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e3041c1c190ff3451901a9a27560aa5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74257945, jitterRate=0.1065296083688736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:09,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:09,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5., pid=37, masterSystemTime=1700078049844 2023-11-15 19:54:09,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:09,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:09,860 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4e3041c1c190ff3451901a9a27560aa5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:09,860 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700078049860"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078049860"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078049860"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078049860"}]},"ts":"1700078049860"} 2023-11-15 19:54:09,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-15 19:54:09,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 4e3041c1c190ff3451901a9a27560aa5, server=jenkins-hbase4.apache.org,42249,1700078002491 in 169 msec 2023-11-15 19:54:09,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-15 19:54:09,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4e3041c1c190ff3451901a9a27560aa5, ASSIGN in 325 msec 2023-11-15 19:54:09,865 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:54:09,865 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078049865"}]},"ts":"1700078049865"} 2023-11-15 19:54:09,866 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-15 19:54:09,869 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:54:09,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1630 sec 2023-11-15 19:54:09,878 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/.tmp/family1/fd8240f68cf7404bae4040eb4bda6aa5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/fd8240f68cf7404bae4040eb4bda6aa5 2023-11-15 19:54:09,882 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 19f0cc58719014d965ff84559b0ced63/family1 of 19f0cc58719014d965ff84559b0ced63 into fd8240f68cf7404bae4040eb4bda6aa5(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:54:09,882 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 19f0cc58719014d965ff84559b0ced63: 2023-11-15 19:54:09,882 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700078048648; duration=1sec 2023-11-15 19:54:09,882 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:09,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/89f4f83abd3644e493c8f4553afd8b29, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/f07722bf5a954852b8349911741ae8e8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_] to archive 2023-11-15 19:54:09,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:09,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/89f4f83abd3644e493c8f4553afd8b29 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/89f4f83abd3644e493c8f4553afd8b29 2023-11-15 19:54:09,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/f07722bf5a954852b8349911741ae8e8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/f07722bf5a954852b8349911741ae8e8 2023-11-15 19:54:09,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/family1/3446aaaf32824d339726204aebbc1eae_SeqId_12_ 2023-11-15 19:54:10,342 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:54:10,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-15 19:54:10,814 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-15 19:54:10,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:10,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,838 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:10,838 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:10,838 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:10,838 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:10,839 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,839 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,840 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:10,840 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:10,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:10,840 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:10,840 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:10,842 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:10,842 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:10,842 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:10,845 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:10,845 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:10,845 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-15 19:54:11,263 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a68dfdf761bc44b8b88b62770053e784 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130a68dfdf761bc44b8b88b62770053e784 2023-11-15 19:54:11,667 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/3d1321881ced454489e9f2fbdb274629 2023-11-15 19:54:11,672 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/3d1321881ced454489e9f2fbdb274629 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/3d1321881ced454489e9f2fbdb274629 2023-11-15 19:54:11,676 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/3d1321881ced454489e9f2fbdb274629, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-15 19:54:11,677 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 832ms, sequenceid=5, compaction requested=false 2023-11-15 19:54:11,677 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:11,678 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:11,678 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:11,678 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:11,678 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:11,678 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,678 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:11,678 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:11,680 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:11,681 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:11,681 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:11,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:11,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:11,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ecf1e54[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:11,682 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:11,682 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,684 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,684 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:11,685 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:11,685 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:11,685 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,685 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:11,686 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,686 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:11,686 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:11,686 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:11,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:11,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:11,689 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:11,689 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:11,689 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:11,689 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,689 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:11,691 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,691 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,691 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:11,691 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,692 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:11,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,695 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:11,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:11,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:11,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:11,695 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:11,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:11,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:11,796 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:11,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:11,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:11,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:11,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,802 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:11,802 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:11,802 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:11,802 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:11,802 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,802 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,804 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:11,804 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:11,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:11,805 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:11,805 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:11,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:11,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,806 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,806 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:11,806 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:11,806 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:11,806 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:11,806 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-15 19:54:12,219 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bc04a98fbcf94c2d88a92b80f33109a5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128bc04a98fbcf94c2d88a92b80f33109a5 2023-11-15 19:54:12,624 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/98f97b500ef942bb9fd0c2285c984ee9 2023-11-15 19:54:12,629 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/98f97b500ef942bb9fd0c2285c984ee9 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/98f97b500ef942bb9fd0c2285c984ee9 2023-11-15 19:54:12,633 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/98f97b500ef942bb9fd0c2285c984ee9, entries=1, sequenceid=9, filesize=5.0 K 2023-11-15 19:54:12,634 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 828ms, sequenceid=9, compaction requested=false 2023-11-15 19:54:12,634 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:12,634 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:12,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:12,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:12,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:12,635 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:12,637 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,637 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:12,637 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:12,637 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:12,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:12,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:12,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:12,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bdacc9f[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:12,639 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:12,639 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,640 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:12,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:12,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:12,640 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,641 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:12,642 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,642 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:12,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:12,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:12,642 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:12,642 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:12,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:12,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:12,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:12,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:12,644 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:12,644 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:12,644 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:12,644 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,644 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:12,652 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,652 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,652 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:12,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:12,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:12,653 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,654 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:12,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:12,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:12,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:12,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:12,660 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:12,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:12,760 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:12,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:12,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:12,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:12,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,766 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:12,766 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:12,766 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:12,766 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:12,767 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,767 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,768 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:12,768 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:12,769 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:12,769 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:12,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:12,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,770 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,770 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:12,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:12,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:12,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:12,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:12,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:12,770 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:12,770 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:12,770 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:12,770 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:13,183 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b60ec832adf84eb3b61d72b9cb4ea4e4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201b60ec832adf84eb3b61d72b9cb4ea4e4 2023-11-15 19:54:13,589 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/40f429665f0c4326a01be64948bc16bc 2023-11-15 19:54:13,594 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/40f429665f0c4326a01be64948bc16bc as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/40f429665f0c4326a01be64948bc16bc 2023-11-15 19:54:13,597 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/40f429665f0c4326a01be64948bc16bc, entries=1, sequenceid=13, filesize=4.9 K 2023-11-15 19:54:13,598 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 828ms, sequenceid=13, compaction requested=true 2023-11-15 19:54:13,598 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:13,598 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:13,598 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:13,598 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:13,598 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,598 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:13,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:13,600 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,600 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:13,600 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,600 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:13,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:13,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3185f280[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:13,602 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:13,602 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,603 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,603 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:13,603 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:13,603 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:13,603 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,603 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:13,604 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,604 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:13,604 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:13,605 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:13,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:13,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:13,607 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:13,607 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:13,607 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:13,607 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,607 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:13,610 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,610 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,610 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:13,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:13,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,611 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,614 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:13,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:13,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:13,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,614 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,714 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:13,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:13,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:13,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:13,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,721 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:13,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:13,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:13,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:13,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,723 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:13,723 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:13,724 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:13,724 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:13,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:13,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:13,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:13,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:13,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:13,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:13,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:13,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:13,725 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:13,725 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:13,725 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:14,138 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205278c5da47efe42cb9cee41ec213b670a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205278c5da47efe42cb9cee41ec213b670a 2023-11-15 19:54:14,544 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/0213f95db9a74406beb46366b4065b41 2023-11-15 19:54:14,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/0213f95db9a74406beb46366b4065b41 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/0213f95db9a74406beb46366b4065b41 2023-11-15 19:54:14,553 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/0213f95db9a74406beb46366b4065b41, entries=1, sequenceid=17, filesize=4.9 K 2023-11-15 19:54:14,553 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 828ms, sequenceid=17, compaction requested=true 2023-11-15 19:54:14,554 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:14,554 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:14,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:14,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:14,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:14,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:14,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,555 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,556 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:14,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:14,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fb28f4[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:14,557 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:14,557 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,560 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,561 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:14,561 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:14,561 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:14,561 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,561 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:14,562 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:14,562 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:14,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,562 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:14,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:14,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:14,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:14,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:14,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:14,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:14,565 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:14,565 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:14,565 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:14,565 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,565 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:14,567 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,567 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:14,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:14,567 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:14,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:14,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:14,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:14,568 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,569 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:14,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:14,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:14,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:14,572 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:14,572 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:14,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:14,673 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:14,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:14,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:14,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:14,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,679 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:14,679 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:14,679 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:14,679 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:14,679 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,679 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,681 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,681 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:14,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:14,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:14,681 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:14,681 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:14,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:14,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,682 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,682 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:14,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:14,682 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:14,682 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:14,682 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:14,683 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:14,683 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:14,683 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:14,683 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:14,683 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:15,095 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122826bb791a21064d08967a851d1d6a8cc5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122826bb791a21064d08967a851d1d6a8cc5 2023-11-15 19:54:15,349 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:54:15,501 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/92ba8bf589064f0388597da31766dfc7 2023-11-15 19:54:15,506 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/92ba8bf589064f0388597da31766dfc7 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/92ba8bf589064f0388597da31766dfc7 2023-11-15 19:54:15,509 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/92ba8bf589064f0388597da31766dfc7, entries=1, sequenceid=21, filesize=4.9 K 2023-11-15 19:54:15,510 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 827ms, sequenceid=21, compaction requested=true 2023-11-15 19:54:15,510 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:15,510 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:15,513 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,513 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:15,513 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,513 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:15,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:15,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3270bb81[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:15,515 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:15,515 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,516 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:15,516 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,516 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:15,518 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:15,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:15,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:15,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:15,520 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:15,520 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:15,520 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:15,520 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,520 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:15,525 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,525 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,525 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:15,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:15,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:15,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:15,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:15,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:15,526 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:15,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,527 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:15,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,529 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,529 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,530 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:15,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:15,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:15,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:15,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:15,530 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:15,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:15,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:15,630 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:15,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:15,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:15,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:15,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,637 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:15,637 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:15,637 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:15,637 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:15,637 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,637 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,639 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:15,639 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:15,639 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:15,639 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,640 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,640 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:15,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:15,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:15,640 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:15,640 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:15,641 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:16,053 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e6b02c685aee4afbaddccdd274b2b439 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e6b02c685aee4afbaddccdd274b2b439 2023-11-15 19:54:16,458 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/eb4254dd79904b50aaf3e6eca4913131 2023-11-15 19:54:16,463 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/eb4254dd79904b50aaf3e6eca4913131 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/eb4254dd79904b50aaf3e6eca4913131 2023-11-15 19:54:16,466 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/eb4254dd79904b50aaf3e6eca4913131, entries=1, sequenceid=25, filesize=4.9 K 2023-11-15 19:54:16,467 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 826ms, sequenceid=25, compaction requested=true 2023-11-15 19:54:16,467 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:16,467 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:16,467 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:16,467 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:16,467 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,467 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:16,467 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:16,470 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,470 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:16,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:16,470 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,471 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:16,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:16,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fc33764[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:16,472 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:16,472 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,473 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,473 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:16,473 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:16,473 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:16,473 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,473 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:16,474 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,475 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:16,475 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:16,475 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:16,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:16,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:16,477 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:16,477 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:16,477 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:16,477 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,477 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:16,479 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,479 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,479 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:16,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:16,479 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:16,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:16,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,481 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:16,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:16,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:16,484 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:16,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:16,484 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:16,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:16,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:16,485 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,485 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,485 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,485 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:16,485 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:16,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:16,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:16,585 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:16,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:16,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:16,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:16,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,591 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:16,591 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:16,591 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:16,591 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:16,592 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,592 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,593 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,593 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:16,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:16,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:16,593 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:16,593 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:16,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,594 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,594 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:16,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:16,594 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:16,594 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:16,595 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:16,595 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:16,595 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:16,595 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:16,595 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:16,595 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:17,007 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ed7b5e595bd949b1a337da43afd757d6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed7b5e595bd949b1a337da43afd757d6 2023-11-15 19:54:17,413 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/1ceec71ef6d5498bbb6170081b594f76 2023-11-15 19:54:17,419 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/1ceec71ef6d5498bbb6170081b594f76 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/1ceec71ef6d5498bbb6170081b594f76 2023-11-15 19:54:17,424 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/1ceec71ef6d5498bbb6170081b594f76, entries=1, sequenceid=29, filesize=4.9 K 2023-11-15 19:54:17,425 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 830ms, sequenceid=29, compaction requested=true 2023-11-15 19:54:17,425 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:17,425 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:17,425 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:17,427 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,427 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:17,428 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,428 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21ccd3ee[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:17,429 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:17,429 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,430 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,431 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:17,431 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:17,431 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:17,431 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,431 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:17,433 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,433 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:17,433 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,433 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:17,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:17,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:17,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:17,435 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:17,436 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:17,436 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:17,436 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,436 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:17,437 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,437 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,437 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:17,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,438 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,440 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,443 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,443 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,443 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:17,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:17,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,444 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:17,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:17,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:17,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:17,444 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:17,545 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:17,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:17,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:17,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:17,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,551 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:17,551 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:17,551 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:17,551 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:17,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:17,553 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:17,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:17,554 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,554 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:17,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,554 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,555 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:17,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:17,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:17,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:17,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:17,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:17,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:17,555 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:17,555 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:17,555 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:17,971 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f0ac6f80b60748de84aea33221316128 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f0ac6f80b60748de84aea33221316128 2023-11-15 19:54:18,376 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/f754c662fd834732b7bc889dc1861955 2023-11-15 19:54:18,381 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/f754c662fd834732b7bc889dc1861955 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/f754c662fd834732b7bc889dc1861955 2023-11-15 19:54:18,385 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/f754c662fd834732b7bc889dc1861955, entries=1, sequenceid=33, filesize=4.9 K 2023-11-15 19:54:18,386 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 831ms, sequenceid=33, compaction requested=true 2023-11-15 19:54:18,386 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:18,386 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:18,386 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:18,386 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:18,386 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,386 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:18,386 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:18,389 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,390 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:18,390 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,390 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:18,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:18,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:18,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c2de3ab[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:18,391 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:18,392 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,395 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,396 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:18,396 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:18,396 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,396 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:18,396 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:18,397 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:18,397 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,397 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:18,397 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:18,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:18,400 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:18,400 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:18,400 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:18,400 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,400 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:18,402 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,402 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:18,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,402 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:18,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:18,402 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,404 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,407 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,407 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,407 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,407 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,407 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:18,407 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:18,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:18,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:18,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:18,407 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:18,407 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,408 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,408 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:18,408 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:18,408 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:18,508 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:18,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:18,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:18,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:18,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,515 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:18,515 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:18,515 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:18,515 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:18,516 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,516 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,517 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:18,517 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:18,518 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,518 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:18,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:18,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,518 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:18,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,519 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:18,519 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:18,519 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:18,519 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:18,519 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:18,519 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:18,519 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:18,519 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:18,932 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090706472369547c46d08b37840adc3ccf50 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090706472369547c46d08b37840adc3ccf50 2023-11-15 19:54:18,937 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/ed5350a2f93a448d9deb2416b7d20cfe 2023-11-15 19:54:18,941 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/ed5350a2f93a448d9deb2416b7d20cfe as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ed5350a2f93a448d9deb2416b7d20cfe 2023-11-15 19:54:18,945 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ed5350a2f93a448d9deb2416b7d20cfe, entries=1, sequenceid=37, filesize=4.9 K 2023-11-15 19:54:18,946 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 427ms, sequenceid=37, compaction requested=true 2023-11-15 19:54:18,946 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:18,946 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:18,946 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:18,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,948 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:18,948 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:18,948 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:18,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:18,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b36f31c[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:18,950 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:18,950 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,951 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:18,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:18,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:18,951 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,951 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:18,953 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:18,953 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:18,953 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,954 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:18,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:18,956 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:18,956 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:18,956 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:18,956 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,956 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:18,958 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,958 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:18,958 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:18,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:18,959 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,960 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:18,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:18,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:18,963 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:18,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:18,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,063 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:19,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:19,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:19,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:19,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,070 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:19,070 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:19,070 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-15 19:54:19,070 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-15 19:54:19,071 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,071 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,072 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,072 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:19,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:19,072 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,072 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:19,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:19,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,073 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,074 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-15 19:54:19,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-15 19:54:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-15 19:54:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:19,074 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:19,074 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:19,074 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. started... 2023-11-15 19:54:19,074 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e3041c1c190ff3451901a9a27560aa5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:19,487 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120448bb30b4ebb414c8adec494973eb458 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120448bb30b4ebb414c8adec494973eb458 2023-11-15 19:54:19,892 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/2c46b7c77b014105a3e54ed6169badc6 2023-11-15 19:54:19,897 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/2c46b7c77b014105a3e54ed6169badc6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/2c46b7c77b014105a3e54ed6169badc6 2023-11-15 19:54:19,901 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/2c46b7c77b014105a3e54ed6169badc6, entries=1, sequenceid=41, filesize=4.9 K 2023-11-15 19:54:19,902 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e3041c1c190ff3451901a9a27560aa5 in 828ms, sequenceid=41, compaction requested=true 2023-11-15 19:54:19,902 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:19,902 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-15 19:54:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-15 19:54:19,905 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:19,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:19,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-15 19:54:19,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d688509[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:19,906 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-15 19:54:19,906 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,908 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,908 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-15 19:54:19,908 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-15 19:54:19,908 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:19,908 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,908 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:19,909 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-15 19:54:19,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:19,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:19,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:19,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-15 19:54:19,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:19,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:19,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:19,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:19,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:54:19,912 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-15 19:54:19,912 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:19,912 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:19,912 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,912 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:19,916 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,916 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,917 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:19,917 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:19,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,918 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,943 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,943 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:19,943 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,943 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:19,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-15 19:54:19,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:19,943 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:19,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-15 19:54:19,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:19,943 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:19,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:19,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:19,944 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:19,944 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:20,044 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:20,046 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-15 19:54:20,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:54:20,048 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:54:20,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:20,049 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078660049 2023-11-15 19:54:20,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:20,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-15 19:54:20,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:20,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x660ad282 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:20,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e22bfd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:20,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,900 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103074b369750a24906a2afd5c4e6bf1785 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103074b369750a24906a2afd5c4e6bf1785 2023-11-15 19:54:20,901 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:20,914 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:20,915 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:20,921 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:20,922 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:20,930 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ba43eddbd1cc4aa8a70e888e530593ba first=Optional[r3] last=Optional[r6] 2023-11-15 19:54:20,930 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ba43eddbd1cc4aa8a70e888e530593ba}] 2023-11-15 19:54:20,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ba43eddbd1cc4aa8a70e888e530593ba for inclusion in 4e3041c1c190ff3451901a9a27560aa5/family1 2023-11-15 19:54:20,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-15 19:54:20,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:20,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:20,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ba43eddbd1cc4aa8a70e888e530593ba to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4er41di3f9stft3pajd7j8dr1te6d5o30tegsofmpl41hb09n137jgl5hh9gf44m/family1/ba43eddbd1cc4aa8a70e888e530593ba 2023-11-15 19:54:20,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4er41di3f9stft3pajd7j8dr1te6d5o30tegsofmpl41hb09n137jgl5hh9gf44m/family1/ba43eddbd1cc4aa8a70e888e530593ba as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_ 2023-11-15 19:54:20,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4er41di3f9stft3pajd7j8dr1te6d5o30tegsofmpl41hb09n137jgl5hh9gf44m/family1/ba43eddbd1cc4aa8a70e888e530593ba into 4e3041c1c190ff3451901a9a27560aa5/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_ - updating store file list. 2023-11-15 19:54:20,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_ into 4e3041c1c190ff3451901a9a27560aa5/family1 2023-11-15 19:54:20,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4er41di3f9stft3pajd7j8dr1te6d5o30tegsofmpl41hb09n137jgl5hh9gf44m/family1/ba43eddbd1cc4aa8a70e888e530593ba into 4e3041c1c190ff3451901a9a27560aa5/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_) 2023-11-15 19:54:20,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4er41di3f9stft3pajd7j8dr1te6d5o30tegsofmpl41hb09n137jgl5hh9gf44m/family1/ba43eddbd1cc4aa8a70e888e530593ba 2023-11-15 19:54:20,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-15 19:54:20,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-15 19:54:20,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 4e3041c1c190ff3451901a9a27560aa5/family1 is initiating minor compaction 2023-11-15 19:54:20,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@12d507af; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:20,948 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4e3041c1c190ff3451901a9a27560aa5/family1 in testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:20,948 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/98f97b500ef942bb9fd0c2285c984ee9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/40f429665f0c4326a01be64948bc16bc, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/0213f95db9a74406beb46366b4065b41, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/92ba8bf589064f0388597da31766dfc7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/eb4254dd79904b50aaf3e6eca4913131, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/1ceec71ef6d5498bbb6170081b594f76, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/f754c662fd834732b7bc889dc1861955, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ed5350a2f93a448d9deb2416b7d20cfe, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/2c46b7c77b014105a3e54ed6169badc6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp, totalSize=50.0 K 2023-11-15 19:54:20,948 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 98f97b500ef942bb9fd0c2285c984ee9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:54:20,948 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 40f429665f0c4326a01be64948bc16bc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:54:20,948 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 0213f95db9a74406beb46366b4065b41, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-15 19:54:20,948 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 92ba8bf589064f0388597da31766dfc7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-15 19:54:20,949 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting eb4254dd79904b50aaf3e6eca4913131, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-15 19:54:20,949 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 1ceec71ef6d5498bbb6170081b594f76, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-15 19:54:20,949 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting f754c662fd834732b7bc889dc1861955, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-15 19:54:20,949 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting ed5350a2f93a448d9deb2416b7d20cfe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-15 19:54:20,949 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 2c46b7c77b014105a3e54ed6169badc6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-15 19:54:20,949 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 13869af3f7e844349b6d80dbebc6c732_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-15 19:54:20,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:20,950 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:20,952 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122826bb791a21064d08967a851d1d6a8cc5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122826bb791a21064d08967a851d1d6a8cc5 2023-11-15 19:54:20,953 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e6b02c685aee4afbaddccdd274b2b439 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e6b02c685aee4afbaddccdd274b2b439 2023-11-15 19:54:20,954 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed7b5e595bd949b1a337da43afd757d6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed7b5e595bd949b1a337da43afd757d6 2023-11-15 19:54:20,955 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f0ac6f80b60748de84aea33221316128 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f0ac6f80b60748de84aea33221316128 2023-11-15 19:54:20,955 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-15 19:54:20,956 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:20,985 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4e3041c1c190ff3451901a9a27560aa5#family1#compaction#48 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:21,800 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/ea63ae372137489c99f567c59e8c1fa3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ea63ae372137489c99f567c59e8c1fa3 2023-11-15 19:54:21,805 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4e3041c1c190ff3451901a9a27560aa5/family1 of 4e3041c1c190ff3451901a9a27560aa5 into ea63ae372137489c99f567c59e8c1fa3(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:54:21,805 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:21,805 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700078060948; duration=0sec 2023-11-15 19:54:21,805 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:21,811 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120598e9626df0fd473ab74dff62a9db5a96 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120598e9626df0fd473ab74dff62a9db5a96 2023-11-15 19:54:21,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:21,836 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/887f8aa47a764235bb41ba275756dc26 first=Optional[r00] last=Optional[r2] 2023-11-15 19:54:21,836 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/887f8aa47a764235bb41ba275756dc26}] 2023-11-15 19:54:21,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/887f8aa47a764235bb41ba275756dc26 for inclusion in 4e3041c1c190ff3451901a9a27560aa5/family1 2023-11-15 19:54:21,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/98f97b500ef942bb9fd0c2285c984ee9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/40f429665f0c4326a01be64948bc16bc, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/0213f95db9a74406beb46366b4065b41, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/92ba8bf589064f0388597da31766dfc7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/eb4254dd79904b50aaf3e6eca4913131, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/1ceec71ef6d5498bbb6170081b594f76, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/f754c662fd834732b7bc889dc1861955, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ed5350a2f93a448d9deb2416b7d20cfe, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/2c46b7c77b014105a3e54ed6169badc6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_] to archive 2023-11-15 19:54:21,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:21,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-15 19:54:21,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:21,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:21,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/98f97b500ef942bb9fd0c2285c984ee9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/98f97b500ef942bb9fd0c2285c984ee9 2023-11-15 19:54:21,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/887f8aa47a764235bb41ba275756dc26 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gne3rlpv6nosbjdvluh93mjh8d1hnq0lravrin07mc8a4mfiffsqbj6ko0ode4nr/family1/887f8aa47a764235bb41ba275756dc26 2023-11-15 19:54:21,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/40f429665f0c4326a01be64948bc16bc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/40f429665f0c4326a01be64948bc16bc 2023-11-15 19:54:21,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gne3rlpv6nosbjdvluh93mjh8d1hnq0lravrin07mc8a4mfiffsqbj6ko0ode4nr/family1/887f8aa47a764235bb41ba275756dc26 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_ 2023-11-15 19:54:21,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/0213f95db9a74406beb46366b4065b41 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/0213f95db9a74406beb46366b4065b41 2023-11-15 19:54:21,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gne3rlpv6nosbjdvluh93mjh8d1hnq0lravrin07mc8a4mfiffsqbj6ko0ode4nr/family1/887f8aa47a764235bb41ba275756dc26 into 4e3041c1c190ff3451901a9a27560aa5/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_ - updating store file list. 2023-11-15 19:54:21,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/92ba8bf589064f0388597da31766dfc7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/92ba8bf589064f0388597da31766dfc7 2023-11-15 19:54:21,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/eb4254dd79904b50aaf3e6eca4913131 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/eb4254dd79904b50aaf3e6eca4913131 2023-11-15 19:54:21,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/1ceec71ef6d5498bbb6170081b594f76 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/1ceec71ef6d5498bbb6170081b594f76 2023-11-15 19:54:21,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_ into 4e3041c1c190ff3451901a9a27560aa5/family1 2023-11-15 19:54:21,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gne3rlpv6nosbjdvluh93mjh8d1hnq0lravrin07mc8a4mfiffsqbj6ko0ode4nr/family1/887f8aa47a764235bb41ba275756dc26 into 4e3041c1c190ff3451901a9a27560aa5/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_) 2023-11-15 19:54:21,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gne3rlpv6nosbjdvluh93mjh8d1hnq0lravrin07mc8a4mfiffsqbj6ko0ode4nr/family1/887f8aa47a764235bb41ba275756dc26 2023-11-15 19:54:21,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-15 19:54:21,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/f754c662fd834732b7bc889dc1861955 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/f754c662fd834732b7bc889dc1861955 2023-11-15 19:54:21,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-15 19:54:21,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 4e3041c1c190ff3451901a9a27560aa5/family1 is initiating minor compaction (all files) 2023-11-15 19:54:21,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2da64a89; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:21,860 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4e3041c1c190ff3451901a9a27560aa5/family1 in testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:54:21,861 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/3d1321881ced454489e9f2fbdb274629, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ea63ae372137489c99f567c59e8c1fa3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp, totalSize=337.0 K 2023-11-15 19:54:21,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ed5350a2f93a448d9deb2416b7d20cfe to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ed5350a2f93a448d9deb2416b7d20cfe 2023-11-15 19:54:21,861 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3d1321881ced454489e9f2fbdb274629, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826299 2023-11-15 19:54:21,862 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting ea63ae372137489c99f567c59e8c1fa3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226299 2023-11-15 19:54:21,862 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting fe4a846720f64bdfa27a3a310b219abf_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878826299 2023-11-15 19:54:21,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/2c46b7c77b014105a3e54ed6169badc6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/2c46b7c77b014105a3e54ed6169badc6 2023-11-15 19:54:21,863 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:21,864 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:21,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/13869af3f7e844349b6d80dbebc6c732_SeqId_44_ 2023-11-15 19:54:21,866 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130a68dfdf761bc44b8b88b62770053e784 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130a68dfdf761bc44b8b88b62770053e784 2023-11-15 19:54:21,867 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201b60ec832adf84eb3b61d72b9cb4ea4e4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201b60ec832adf84eb3b61d72b9cb4ea4e4 2023-11-15 19:54:21,869 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205278c5da47efe42cb9cee41ec213b670a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205278c5da47efe42cb9cee41ec213b670a 2023-11-15 19:54:21,869 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-15 19:54:21,869 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-15 19:54:21,870 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-15 19:54:21,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-15 19:54:21,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:21,871 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:54:21,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8240 sec 2023-11-15 19:54:21,884 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4e3041c1c190ff3451901a9a27560aa5#family1#compaction#49 average throughput is 15.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:21,976 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251 (was 259), OpenFileDescriptor=640 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 214), ProcessCount=174 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=935 (was 942) 2023-11-15 19:54:21,987 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=174, AvailableMemoryMB=935 2023-11-15 19:54:21,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-15 19:54:21,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:21,991 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:54:21,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-15 19:54:21,992 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:54:21,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-15 19:54:21,993 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:21,994 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 empty. 2023-11-15 19:54:21,994 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:21,994 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-15 19:54:22,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-15 19:54:22,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-15 19:54:22,307 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/.tmp/family1/7bbb5e5dddf4418bacae9e4d97eeeffa as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/7bbb5e5dddf4418bacae9e4d97eeeffa 2023-11-15 19:54:22,312 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4e3041c1c190ff3451901a9a27560aa5/family1 of 4e3041c1c190ff3451901a9a27560aa5 into 7bbb5e5dddf4418bacae9e4d97eeeffa(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:54:22,312 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:54:22,312 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700078061860; duration=0sec 2023-11-15 19:54:22,312 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:22,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/3d1321881ced454489e9f2fbdb274629, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ea63ae372137489c99f567c59e8c1fa3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_] to archive 2023-11-15 19:54:22,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:22,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/3d1321881ced454489e9f2fbdb274629 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/3d1321881ced454489e9f2fbdb274629 2023-11-15 19:54:22,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ea63ae372137489c99f567c59e8c1fa3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/ea63ae372137489c99f567c59e8c1fa3 2023-11-15 19:54:22,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/family1/fe4a846720f64bdfa27a3a310b219abf_SeqId_47_ 2023-11-15 19:54:22,402 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-15 19:54:22,403 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b18eb7fb184cf7b1796f0be6fae82a7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:54:22,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-15 19:54:22,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:22,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 1b18eb7fb184cf7b1796f0be6fae82a7, disabling compactions & flushes 2023-11-15 19:54:22,809 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:22,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:22,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. after waiting 0 ms 2023-11-15 19:54:22,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:22,809 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:22,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:22,813 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:54:22,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078062814"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078062814"}]},"ts":"1700078062814"} 2023-11-15 19:54:22,815 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:54:22,816 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:54:22,816 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078062816"}]},"ts":"1700078062816"} 2023-11-15 19:54:22,817 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-15 19:54:22,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, ASSIGN}] 2023-11-15 19:54:22,823 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, ASSIGN 2023-11-15 19:54:22,824 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:54:22,975 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:22,975 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078062974"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078062974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078062974"}]},"ts":"1700078062974"} 2023-11-15 19:54:22,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:23,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-15 19:54:23,128 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:23,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:23,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b18eb7fb184cf7b1796f0be6fae82a7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:23,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:23,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:23,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:23,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:23,132 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:23,134 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:23,134 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:23,134 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b18eb7fb184cf7b1796f0be6fae82a7 columnFamilyName family1 2023-11-15 19:54:23,135 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(310): Store=1b18eb7fb184cf7b1796f0be6fae82a7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:23,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:23,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:23,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:54:23,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b18eb7fb184cf7b1796f0be6fae82a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60014528, jitterRate=-0.1057138442993164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:23,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., pid=41, masterSystemTime=1700078063128 2023-11-15 19:54:23,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:23,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:23,143 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:23,144 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078063143"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078063143"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078063143"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078063143"}]},"ts":"1700078063143"} 2023-11-15 19:54:23,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-15 19:54:23,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491 in 169 msec 2023-11-15 19:54:23,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-15 19:54:23,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, ASSIGN in 324 msec 2023-11-15 19:54:23,148 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:54:23,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078063149"}]},"ts":"1700078063149"} 2023-11-15 19:54:23,150 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-15 19:54:23,152 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:54:23,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1630 sec 2023-11-15 19:54:23,808 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:24,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-15 19:54:24,097 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-15 19:54:24,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:24,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,118 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:24,118 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:24,118 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:24,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:24,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,120 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:24,120 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:24,121 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,121 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,121 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,122 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:24,122 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:24,122 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:24,122 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:24,122 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:24,122 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:24,122 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:24,123 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-15 19:54:24,541 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305cc5ed227ed145f4903c24729e805bb3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511305cc5ed227ed145f4903c24729e805bb3 2023-11-15 19:54:24,945 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/abb983f319e44508a31d884b725d84b1 2023-11-15 19:54:24,951 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/abb983f319e44508a31d884b725d84b1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/abb983f319e44508a31d884b725d84b1 2023-11-15 19:54:24,954 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/abb983f319e44508a31d884b725d84b1, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-15 19:54:24,955 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 832ms, sequenceid=5, compaction requested=false 2023-11-15 19:54:24,956 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:24,956 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:24,959 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,959 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:24,959 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,959 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:24,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:24,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a7c68e9[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:24,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:24,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,962 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,962 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:24,962 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:24,962 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:24,962 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,962 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:24,964 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,964 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:24,964 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:24,964 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:24,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:24,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:24,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:24,966 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:24,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:24,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:24,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,966 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:24,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:24,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:24,969 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,970 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:24,974 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:24,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-15 19:54:24,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:24,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:24,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:24,974 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:24,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:24,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:24,975 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:25,075 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:25,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:25,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:25,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:25,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,081 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:25,081 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:25,081 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:25,081 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:25,082 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,082 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,083 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:25,083 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:25,084 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,084 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,085 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:25,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,085 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:25,085 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:25,085 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:25,085 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:25,085 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:25,085 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:25,085 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:25,085 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-15 19:54:25,498 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128835fcaf07ee549e6939bee2a45e18666 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128835fcaf07ee549e6939bee2a45e18666 2023-11-15 19:54:25,904 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/51313d49235c49a392d52f9aea0ae3ad 2023-11-15 19:54:25,909 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/51313d49235c49a392d52f9aea0ae3ad as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/51313d49235c49a392d52f9aea0ae3ad 2023-11-15 19:54:25,913 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/51313d49235c49a392d52f9aea0ae3ad, entries=1, sequenceid=9, filesize=5.0 K 2023-11-15 19:54:25,914 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 829ms, sequenceid=9, compaction requested=false 2023-11-15 19:54:25,914 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:25,914 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:25,917 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:25,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:25,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@395ff6b6[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:25,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:25,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,921 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:25,921 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,921 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:25,923 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:25,923 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,923 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:25,923 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:25,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:25,925 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:25,925 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:25,925 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:25,925 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,925 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:25,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:25,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:25,927 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,929 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:25,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:25,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:25,937 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:25,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:25,937 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,037 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:26,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:26,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:26,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:26,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,044 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:26,044 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:26,044 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:26,044 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:26,044 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,044 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,046 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:26,046 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:26,046 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,047 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:26,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:26,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,047 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,047 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:26,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:26,048 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:26,048 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:26,048 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:26,048 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:26,462 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d63a31b5c17e4184931c62e293d28e5f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d63a31b5c17e4184931c62e293d28e5f 2023-11-15 19:54:26,867 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/3ee02ccd11e641abac951e0f45b25d63 2023-11-15 19:54:26,872 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/3ee02ccd11e641abac951e0f45b25d63 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/3ee02ccd11e641abac951e0f45b25d63 2023-11-15 19:54:26,876 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/3ee02ccd11e641abac951e0f45b25d63, entries=1, sequenceid=13, filesize=5.0 K 2023-11-15 19:54:26,877 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 829ms, sequenceid=13, compaction requested=true 2023-11-15 19:54:26,877 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:26,877 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:26,877 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:26,880 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,880 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:26,881 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:26,881 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@458d5c92[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:26,882 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:26,882 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,884 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,884 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:26,884 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:26,884 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:26,884 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,884 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:26,887 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,887 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:26,887 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:26,887 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:26,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:26,889 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:26,889 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:26,889 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:26,889 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,889 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:26,891 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,891 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,891 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:26,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:26,892 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,893 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,896 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:26,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:26,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:26,896 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:26,996 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:26,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:27,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:27,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:27,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,003 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:27,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:27,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:27,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:27,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,004 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,004 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:27,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:27,005 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,005 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,006 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:27,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:27,006 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:27,007 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:27,007 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:27,419 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120541be094cc7ca45c794c98360681d54e3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120541be094cc7ca45c794c98360681d54e3 2023-11-15 19:54:27,824 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/fd3482bd7d924a2b8244447d368e3d08 2023-11-15 19:54:27,829 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/fd3482bd7d924a2b8244447d368e3d08 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/fd3482bd7d924a2b8244447d368e3d08 2023-11-15 19:54:27,833 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/fd3482bd7d924a2b8244447d368e3d08, entries=1, sequenceid=17, filesize=5.0 K 2023-11-15 19:54:27,834 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 827ms, sequenceid=17, compaction requested=true 2023-11-15 19:54:27,834 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:27,834 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:27,834 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:27,834 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:27,834 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,834 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:27,834 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:27,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,836 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:27,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:27,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:27,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c64c9e7[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:27,838 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:27,838 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,839 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,840 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:27,840 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:27,840 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,840 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:27,840 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:27,841 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:27,841 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:27,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:27,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:27,844 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:27,844 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:27,844 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:27,844 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,844 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:27,847 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,847 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,847 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:27,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:27,848 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,849 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,851 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:27,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:27,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:27,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:27,852 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,852 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,853 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,952 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:27,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:27,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:27,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:27,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,959 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:27,959 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:27,959 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:27,959 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:27,959 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,959 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,964 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,964 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:27,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:27,964 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:27,964 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:27,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,965 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,965 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:27,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:27,966 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:27,966 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:27,966 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:27,966 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:28,377 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ff8218a4d8374d7c89c77b8193cc63b4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff8218a4d8374d7c89c77b8193cc63b4 2023-11-15 19:54:28,659 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:54:28,783 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/ae4330ff28e84f22a1651d3ead1958c8 2023-11-15 19:54:28,789 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/ae4330ff28e84f22a1651d3ead1958c8 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ae4330ff28e84f22a1651d3ead1958c8 2023-11-15 19:54:28,793 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ae4330ff28e84f22a1651d3ead1958c8, entries=1, sequenceid=21, filesize=5.0 K 2023-11-15 19:54:28,793 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 827ms, sequenceid=21, compaction requested=true 2023-11-15 19:54:28,793 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:28,793 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:28,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:28,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:28,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:28,794 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:28,797 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,797 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:28,797 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:28,797 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:28,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:28,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2516dfa2[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:28,799 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:28,799 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,800 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,800 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:28,800 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:28,800 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:28,800 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,800 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:28,801 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,801 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:28,802 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:28,802 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:28,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:28,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:28,804 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:28,804 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:28,804 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:28,804 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,804 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:28,805 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,806 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:28,806 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:28,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:28,806 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,807 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:28,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,812 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:28,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:28,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:28,812 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:28,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:28,912 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:28,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:28,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:28,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:28,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,919 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:28,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:28,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:28,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:28,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,921 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:28,921 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:28,921 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:28,921 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:28,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,922 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,922 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:28,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:28,922 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:28,922 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:28,922 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:28,922 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:28,922 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:28,922 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:28,922 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:28,922 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:29,335 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231993a60ebefa8427c93b9aae553fda1d5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231993a60ebefa8427c93b9aae553fda1d5 2023-11-15 19:54:29,741 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/82fb0fc87c714193abc7e82c8aaf1cd3 2023-11-15 19:54:29,746 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/82fb0fc87c714193abc7e82c8aaf1cd3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/82fb0fc87c714193abc7e82c8aaf1cd3 2023-11-15 19:54:29,750 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/82fb0fc87c714193abc7e82c8aaf1cd3, entries=1, sequenceid=25, filesize=5.0 K 2023-11-15 19:54:29,751 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 829ms, sequenceid=25, compaction requested=true 2023-11-15 19:54:29,751 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:29,751 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,753 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,753 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:29,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:29,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ba77f0[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:29,755 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:29,755 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,756 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,756 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:29,756 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:29,756 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:29,757 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,757 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:29,760 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,760 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:29,760 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:29,760 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:29,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:29,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:29,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:29,762 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:29,762 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:29,762 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:29,762 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,762 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:29,764 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,764 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,764 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:29,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:29,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:29,765 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,766 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,768 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:29,768 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,768 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:29,768 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,768 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,768 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:29,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:29,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:29,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:29,768 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,769 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,769 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,769 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:29,769 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:29,769 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:29,869 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:29,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:29,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:29,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:29,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,875 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:29,875 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:29,875 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:29,875 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:29,876 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,876 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:29,877 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:29,877 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,877 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:29,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,878 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,878 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:29,879 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:29,879 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:29,879 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:30,291 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010186faa2e466c04cf79d931d82d5cbdf9c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010186faa2e466c04cf79d931d82d5cbdf9c 2023-11-15 19:54:30,696 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/06205530ae3f4e6fbe93d39edf358279 2023-11-15 19:54:30,701 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/06205530ae3f4e6fbe93d39edf358279 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/06205530ae3f4e6fbe93d39edf358279 2023-11-15 19:54:30,705 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/06205530ae3f4e6fbe93d39edf358279, entries=1, sequenceid=29, filesize=5.0 K 2023-11-15 19:54:30,705 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 826ms, sequenceid=29, compaction requested=true 2023-11-15 19:54:30,705 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:30,706 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:30,706 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:30,709 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,709 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:30,709 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,709 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:30,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:30,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c7cded9[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:30,711 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:30,711 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,712 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:30,712 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:30,712 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,712 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:30,716 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:30,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:30,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:30,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:30,719 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:30,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:30,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:30,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,719 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:30,721 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,721 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:30,721 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:30,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:30,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:30,722 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:30,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,723 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:30,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:30,726 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:30,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:30,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:30,726 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:30,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:30,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:30,827 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:30,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:30,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:30,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:30,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,832 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:30,832 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:30,832 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:30,832 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:30,833 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,833 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,834 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:30,834 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:30,835 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:30,835 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:30,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,836 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,836 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:30,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:30,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:30,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:30,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:30,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:30,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:30,836 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:30,836 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:30,836 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:31,249 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038114cc798a0d402dbfc98699a11628b5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038114cc798a0d402dbfc98699a11628b5 2023-11-15 19:54:31,655 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/8122e23f27254c3eb869af3539a8d817 2023-11-15 19:54:31,660 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/8122e23f27254c3eb869af3539a8d817 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/8122e23f27254c3eb869af3539a8d817 2023-11-15 19:54:31,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/8122e23f27254c3eb869af3539a8d817, entries=1, sequenceid=33, filesize=5.0 K 2023-11-15 19:54:31,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 828ms, sequenceid=33, compaction requested=true 2023-11-15 19:54:31,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:31,665 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:31,666 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,666 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:31,667 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,667 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:31,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:31,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:31,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61d1d40[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:31,668 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:31,668 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,670 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,670 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:31,670 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:31,671 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:31,671 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,671 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:31,672 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:31,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:31,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:31,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:31,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:31,674 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:31,674 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:31,674 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:31,674 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,674 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:31,676 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,676 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:31,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,676 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:31,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:31,676 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:31,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:31,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,678 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:31,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:31,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:31,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:31,680 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:31,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:31,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:31,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:31,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,680 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,681 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,681 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,681 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:31,681 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:31,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:31,781 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:31,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:31,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:31,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:31,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,787 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:31,787 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:31,787 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:31,787 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:31,787 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,787 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,790 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,790 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:31,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:31,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:31,790 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:31,790 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:31,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:31,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,791 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:31,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:31,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:31,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:31,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:31,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:31,791 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:31,791 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:31,791 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:31,791 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:32,203 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f72011f2a6c44dcc98815ec6dbbb80a4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907f72011f2a6c44dcc98815ec6dbbb80a4 2023-11-15 19:54:32,609 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/876ea099766c40dbaada6b4c78cf5ae5 2023-11-15 19:54:32,614 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/876ea099766c40dbaada6b4c78cf5ae5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/876ea099766c40dbaada6b4c78cf5ae5 2023-11-15 19:54:32,617 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/876ea099766c40dbaada6b4c78cf5ae5, entries=1, sequenceid=37, filesize=5.0 K 2023-11-15 19:54:32,618 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 827ms, sequenceid=37, compaction requested=true 2023-11-15 19:54:32,618 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:32,618 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:32,618 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:32,620 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,620 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:32,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:32,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@156529ee[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:32,622 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:32,622 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,623 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,624 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:32,624 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:32,624 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,624 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:32,624 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:32,625 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:32,625 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,625 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:32,625 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:32,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:32,628 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:32,628 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:32,628 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:32,628 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,628 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:32,634 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,634 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:32,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,634 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:32,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:32,635 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,636 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:32,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:32,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-15 19:54:32,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:32,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:32,641 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:32,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:32,641 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,741 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:32,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:32,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:32,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:32,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,748 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:32,748 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:32,748 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-15 19:54:32,748 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-15 19:54:32,748 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,748 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,750 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:32,750 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:32,751 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:32,751 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,751 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,751 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-15 19:54:32,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:32,752 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-15 19:54:32,752 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:32,752 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-15 19:54:32,752 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:32,752 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:32,752 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:32,752 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. started... 2023-11-15 19:54:32,752 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b18eb7fb184cf7b1796f0be6fae82a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:33,164 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f6fa4e5660434fcda786dfa7ad17e0ce to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120f6fa4e5660434fcda786dfa7ad17e0ce 2023-11-15 19:54:33,569 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/e28cc1f3bba04c7f9d070d4b482b5528 2023-11-15 19:54:33,574 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/e28cc1f3bba04c7f9d070d4b482b5528 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/e28cc1f3bba04c7f9d070d4b482b5528 2023-11-15 19:54:33,577 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/e28cc1f3bba04c7f9d070d4b482b5528, entries=1, sequenceid=41, filesize=5.0 K 2023-11-15 19:54:33,578 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b18eb7fb184cf7b1796f0be6fae82a7 in 826ms, sequenceid=41, compaction requested=true 2023-11-15 19:54:33,578 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:33,578 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-15 19:54:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-15 19:54:33,581 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,581 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:33,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:33,581 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,581 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:33,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:33,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:33,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:33,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-15 19:54:33,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25d0d945[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:33,583 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-15 19:54:33,583 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,584 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,584 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-15 19:54:33,584 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-15 19:54:33,584 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:33,584 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,584 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:33,586 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,586 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-15 19:54:33,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:33,586 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:33,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:33,586 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-15 19:54:33,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:33,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:33,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:33,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:33,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-15 19:54:33,588 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-15 19:54:33,588 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:33,588 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:33,588 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,588 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:33,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:33,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:33,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:33,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:33,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:33,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:33,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,591 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:33,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:33,592 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,595 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:33,596 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:33,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-15 19:54:33,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:33,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:33,596 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:33,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:33,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:33,696 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:33,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:33,698 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:33,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:33,700 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:33,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:33,701 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078673701 2023-11-15 19:54:33,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:33,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-15 19:54:33,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:33,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x0440f8c5 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:33,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d48c15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:33,710 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,546 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035375233894e542979f2d353d0b171603 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601035375233894e542979f2d353d0b171603 2023-11-15 19:54:34,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:34,561 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:34,562 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:34,568 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:34,570 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:34,585 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19a2b36951e34ffa93fed1be8fb5c78b first=Optional[r3] last=Optional[r6] 2023-11-15 19:54:34,586 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19a2b36951e34ffa93fed1be8fb5c78b}] 2023-11-15 19:54:34,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19a2b36951e34ffa93fed1be8fb5c78b for inclusion in 1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:34,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-15 19:54:34,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:34,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:34,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19a2b36951e34ffa93fed1be8fb5c78b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__barc6fadr2of6h4kosle0luffmvlhf210hms9b2712b3oeld3p55lbhbsqbutn0k/family1/19a2b36951e34ffa93fed1be8fb5c78b 2023-11-15 19:54:34,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__barc6fadr2of6h4kosle0luffmvlhf210hms9b2712b3oeld3p55lbhbsqbutn0k/family1/19a2b36951e34ffa93fed1be8fb5c78b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_ 2023-11-15 19:54:34,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__barc6fadr2of6h4kosle0luffmvlhf210hms9b2712b3oeld3p55lbhbsqbutn0k/family1/19a2b36951e34ffa93fed1be8fb5c78b into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_ - updating store file list. 2023-11-15 19:54:34,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_ into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:34,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__barc6fadr2of6h4kosle0luffmvlhf210hms9b2712b3oeld3p55lbhbsqbutn0k/family1/19a2b36951e34ffa93fed1be8fb5c78b into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_) 2023-11-15 19:54:34,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__barc6fadr2of6h4kosle0luffmvlhf210hms9b2712b3oeld3p55lbhbsqbutn0k/family1/19a2b36951e34ffa93fed1be8fb5c78b 2023-11-15 19:54:34,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-15 19:54:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-15 19:54:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 1b18eb7fb184cf7b1796f0be6fae82a7/family1 is initiating minor compaction 2023-11-15 19:54:34,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6b9c420a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:34,604 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1b18eb7fb184cf7b1796f0be6fae82a7/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:34,604 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/51313d49235c49a392d52f9aea0ae3ad, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/3ee02ccd11e641abac951e0f45b25d63, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/fd3482bd7d924a2b8244447d368e3d08, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ae4330ff28e84f22a1651d3ead1958c8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/82fb0fc87c714193abc7e82c8aaf1cd3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/06205530ae3f4e6fbe93d39edf358279, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/8122e23f27254c3eb869af3539a8d817, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/876ea099766c40dbaada6b4c78cf5ae5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/e28cc1f3bba04c7f9d070d4b482b5528, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp, totalSize=50.4 K 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 51313d49235c49a392d52f9aea0ae3ad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3ee02ccd11e641abac951e0f45b25d63, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting fd3482bd7d924a2b8244447d368e3d08, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting ae4330ff28e84f22a1651d3ead1958c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 82fb0fc87c714193abc7e82c8aaf1cd3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 06205530ae3f4e6fbe93d39edf358279, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 8122e23f27254c3eb869af3539a8d817, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 876ea099766c40dbaada6b4c78cf5ae5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting e28cc1f3bba04c7f9d070d4b482b5528, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-15 19:54:34,604 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-15 19:54:34,606 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:34,606 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:34,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff8218a4d8374d7c89c77b8193cc63b4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ff8218a4d8374d7c89c77b8193cc63b4 2023-11-15 19:54:34,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231993a60ebefa8427c93b9aae553fda1d5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231993a60ebefa8427c93b9aae553fda1d5 2023-11-15 19:54:34,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010186faa2e466c04cf79d931d82d5cbdf9c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010186faa2e466c04cf79d931d82d5cbdf9c 2023-11-15 19:54:34,611 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038114cc798a0d402dbfc98699a11628b5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038114cc798a0d402dbfc98699a11628b5 2023-11-15 19:54:34,611 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-15 19:54:34,611 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:34,637 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1b18eb7fb184cf7b1796f0be6fae82a7#family1#compaction#60 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:35,454 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/a6d7b93d4adb464cad3f5364780a986b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/a6d7b93d4adb464cad3f5364780a986b 2023-11-15 19:54:35,459 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1b18eb7fb184cf7b1796f0be6fae82a7/family1 of 1b18eb7fb184cf7b1796f0be6fae82a7 into a6d7b93d4adb464cad3f5364780a986b(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:54:35,459 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:35,459 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700078074603; duration=0sec 2023-11-15 19:54:35,459 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:35,462 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f6b388d81aa84c0fa3a031de3590a76d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f6b388d81aa84c0fa3a031de3590a76d 2023-11-15 19:54:35,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:35,486 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b3d491ba96024fa9b86fb9e1826cd1dd first=Optional[r00] last=Optional[r2] 2023-11-15 19:54:35,486 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b3d491ba96024fa9b86fb9e1826cd1dd}] 2023-11-15 19:54:35,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b3d491ba96024fa9b86fb9e1826cd1dd for inclusion in 1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:35,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-15 19:54:35,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:35,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:35,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b3d491ba96024fa9b86fb9e1826cd1dd to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__chi0u6fournosvm9uac65kbfu0ntgfujp50efjgqqe2lvufhg5q0rk1vpd9gp06p/family1/b3d491ba96024fa9b86fb9e1826cd1dd 2023-11-15 19:54:35,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__chi0u6fournosvm9uac65kbfu0ntgfujp50efjgqqe2lvufhg5q0rk1vpd9gp06p/family1/b3d491ba96024fa9b86fb9e1826cd1dd as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_ 2023-11-15 19:54:35,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__chi0u6fournosvm9uac65kbfu0ntgfujp50efjgqqe2lvufhg5q0rk1vpd9gp06p/family1/b3d491ba96024fa9b86fb9e1826cd1dd into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_ - updating store file list. 2023-11-15 19:54:35,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_ into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:35,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__chi0u6fournosvm9uac65kbfu0ntgfujp50efjgqqe2lvufhg5q0rk1vpd9gp06p/family1/b3d491ba96024fa9b86fb9e1826cd1dd into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_) 2023-11-15 19:54:35,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__chi0u6fournosvm9uac65kbfu0ntgfujp50efjgqqe2lvufhg5q0rk1vpd9gp06p/family1/b3d491ba96024fa9b86fb9e1826cd1dd 2023-11-15 19:54:35,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-15 19:54:35,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-15 19:54:35,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 1b18eb7fb184cf7b1796f0be6fae82a7/family1 is initiating minor compaction (all files) 2023-11-15 19:54:35,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@ee79dd8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:35,499 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1b18eb7fb184cf7b1796f0be6fae82a7/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:35,499 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/abb983f319e44508a31d884b725d84b1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/a6d7b93d4adb464cad3f5364780a986b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp, totalSize=390.1 K 2023-11-15 19:54:35,500 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting abb983f319e44508a31d884b725d84b1, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826299 2023-11-15 19:54:35,500 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting a6d7b93d4adb464cad3f5364780a986b, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226299 2023-11-15 19:54:35,501 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878826299 2023-11-15 19:54:35,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:35,501 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:35,503 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511305cc5ed227ed145f4903c24729e805bb3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511305cc5ed227ed145f4903c24729e805bb3 2023-11-15 19:54:35,504 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d63a31b5c17e4184931c62e293d28e5f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d63a31b5c17e4184931c62e293d28e5f 2023-11-15 19:54:35,505 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120541be094cc7ca45c794c98360681d54e3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120541be094cc7ca45c794c98360681d54e3 2023-11-15 19:54:35,506 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-15 19:54:35,506 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-15 19:54:35,506 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:35,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:35,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:35,507 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:35,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8080 sec 2023-11-15 19:54:35,517 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1b18eb7fb184cf7b1796f0be6fae82a7#family1#compaction#61 average throughput is 22.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:35,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/51313d49235c49a392d52f9aea0ae3ad, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/3ee02ccd11e641abac951e0f45b25d63, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/fd3482bd7d924a2b8244447d368e3d08, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ae4330ff28e84f22a1651d3ead1958c8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/82fb0fc87c714193abc7e82c8aaf1cd3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/06205530ae3f4e6fbe93d39edf358279, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/8122e23f27254c3eb869af3539a8d817, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/876ea099766c40dbaada6b4c78cf5ae5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/e28cc1f3bba04c7f9d070d4b482b5528, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_] to archive 2023-11-15 19:54:35,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:35,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/51313d49235c49a392d52f9aea0ae3ad to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/51313d49235c49a392d52f9aea0ae3ad 2023-11-15 19:54:35,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/3ee02ccd11e641abac951e0f45b25d63 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/3ee02ccd11e641abac951e0f45b25d63 2023-11-15 19:54:35,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/fd3482bd7d924a2b8244447d368e3d08 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/fd3482bd7d924a2b8244447d368e3d08 2023-11-15 19:54:35,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ae4330ff28e84f22a1651d3ead1958c8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ae4330ff28e84f22a1651d3ead1958c8 2023-11-15 19:54:35,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/82fb0fc87c714193abc7e82c8aaf1cd3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/82fb0fc87c714193abc7e82c8aaf1cd3 2023-11-15 19:54:35,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/06205530ae3f4e6fbe93d39edf358279 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/06205530ae3f4e6fbe93d39edf358279 2023-11-15 19:54:35,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/8122e23f27254c3eb869af3539a8d817 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/8122e23f27254c3eb869af3539a8d817 2023-11-15 19:54:35,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/876ea099766c40dbaada6b4c78cf5ae5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/876ea099766c40dbaada6b4c78cf5ae5 2023-11-15 19:54:35,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/e28cc1f3bba04c7f9d070d4b482b5528 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/e28cc1f3bba04c7f9d070d4b482b5528 2023-11-15 19:54:35,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/97b1bd99f1c14ecd939b94c9b3affc83_SeqId_44_ 2023-11-15 19:54:35,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-15 19:54:35,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:35,994 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-15 19:54:35,995 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-15 19:54:35,995 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-15 19:54:35,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-15 19:54:35,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE}] 2023-11-15 19:54:36,000 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE 2023-11-15 19:54:36,001 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:36,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078076000"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078076000"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078076000"}]},"ts":"1700078076000"} 2023-11-15 19:54:36,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:36,153 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:36,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:36,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b18eb7fb184cf7b1796f0be6fae82a7, disabling compactions & flushes 2023-11-15 19:54:36,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:36,736 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/.tmp/family1/ffe4101107a549c2a1f8935601aaaec6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ffe4101107a549c2a1f8935601aaaec6 2023-11-15 19:54:36,740 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1b18eb7fb184cf7b1796f0be6fae82a7/family1 of 1b18eb7fb184cf7b1796f0be6fae82a7 into ffe4101107a549c2a1f8935601aaaec6(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:54:36,740 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:36,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:36,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:36,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. after waiting 0 ms 2023-11-15 19:54:36,741 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1700078075499; duration=1sec 2023-11-15 19:54:36,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:36,741 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:36,741 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/abb983f319e44508a31d884b725d84b1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/a6d7b93d4adb464cad3f5364780a986b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_] to archive 2023-11-15 19:54:36,742 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:36,743 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/abb983f319e44508a31d884b725d84b1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/abb983f319e44508a31d884b725d84b1 2023-11-15 19:54:36,744 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/a6d7b93d4adb464cad3f5364780a986b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/a6d7b93d4adb464cad3f5364780a986b 2023-11-15 19:54:36,745 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/68f9ee715e7f4e13b04c8f30cadd206f_SeqId_47_ 2023-11-15 19:54:36,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-15 19:54:36,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:36,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:36,751 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 1b18eb7fb184cf7b1796f0be6fae82a7 to self. 2023-11-15 19:54:36,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:36,752 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=CLOSED 2023-11-15 19:54:36,753 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078076752"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078076752"}]},"ts":"1700078076752"} 2023-11-15 19:54:36,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-15 19:54:36,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491 in 752 msec 2023-11-15 19:54:36,756 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=true 2023-11-15 19:54:36,906 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:36,906 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078076906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078076906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078076906"}]},"ts":"1700078076906"} 2023-11-15 19:54:36,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:37,059 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:37,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:37,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b18eb7fb184cf7b1796f0be6fae82a7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:37,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:37,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:37,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:37,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:37,063 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:37,064 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:37,064 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:37,064 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b18eb7fb184cf7b1796f0be6fae82a7 columnFamilyName family1 2023-11-15 19:54:37,069 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ffe4101107a549c2a1f8935601aaaec6 2023-11-15 19:54:37,069 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(310): Store=1b18eb7fb184cf7b1796f0be6fae82a7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:37,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:37,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:37,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:37,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b18eb7fb184cf7b1796f0be6fae82a7; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65260520, jitterRate=-0.027542471885681152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:37,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:37,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., pid=47, masterSystemTime=1700078077059 2023-11-15 19:54:37,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:37,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:37,077 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:37,077 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078077077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078077077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078077077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078077077"}]},"ts":"1700078077077"} 2023-11-15 19:54:37,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-15 19:54:37,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491 in 171 msec 2023-11-15 19:54:37,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-15 19:54:37,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE in 1.0800 sec 2023-11-15 19:54:37,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-15 19:54:37,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0850 sec 2023-11-15 19:54:37,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4980 sec 2023-11-15 19:54:37,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-15 19:54:37,086 INFO [Listener at localhost/43577] compactions.TestMobCompactor(278): alter status finished 2023-11-15 19:54:37,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:37,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:37,089 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:37,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:37,089 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078677089 2023-11-15 19:54:37,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:37,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-15 19:54:37,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:37,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x44204cd8 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:37,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6535c46d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:37,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,923 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b9e1239bbbe74544b1f9fe1da0313f90 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b9e1239bbbe74544b1f9fe1da0313f90 2023-11-15 19:54:37,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:37,937 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:37,938 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:37,943 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:37,945 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:37,953 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/95ca3fa4bc914808a8f504cd52552e6c first=Optional[r05] last=Optional[r8] 2023-11-15 19:54:37,954 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=51 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/95ca3fa4bc914808a8f504cd52552e6c}] 2023-11-15 19:54:37,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/95ca3fa4bc914808a8f504cd52552e6c for inclusion in 1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:37,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-15 19:54:37,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:37,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:37,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/95ca3fa4bc914808a8f504cd52552e6c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__38s9p7u4aqplcgsol24v0cai60kmo4e9om4s9bj5294u0ekao5jg67kqkam1o7ma/family1/95ca3fa4bc914808a8f504cd52552e6c 2023-11-15 19:54:37,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__38s9p7u4aqplcgsol24v0cai60kmo4e9om4s9bj5294u0ekao5jg67kqkam1o7ma/family1/95ca3fa4bc914808a8f504cd52552e6c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/2e4e797cd49749b6a89d56cb38babcbd_SeqId_53_ 2023-11-15 19:54:37,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__38s9p7u4aqplcgsol24v0cai60kmo4e9om4s9bj5294u0ekao5jg67kqkam1o7ma/family1/95ca3fa4bc914808a8f504cd52552e6c into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/2e4e797cd49749b6a89d56cb38babcbd_SeqId_53_ - updating store file list. 2023-11-15 19:54:37,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/2e4e797cd49749b6a89d56cb38babcbd_SeqId_53_ into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:37,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__38s9p7u4aqplcgsol24v0cai60kmo4e9om4s9bj5294u0ekao5jg67kqkam1o7ma/family1/95ca3fa4bc914808a8f504cd52552e6c into 1b18eb7fb184cf7b1796f0be6fae82a7/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/2e4e797cd49749b6a89d56cb38babcbd_SeqId_53_) 2023-11-15 19:54:37,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__38s9p7u4aqplcgsol24v0cai60kmo4e9om4s9bj5294u0ekao5jg67kqkam1o7ma/family1/95ca3fa4bc914808a8f504cd52552e6c 2023-11-15 19:54:37,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:37,972 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:37,973 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120f6fa4e5660434fcda786dfa7ad17e0ce to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120f6fa4e5660434fcda786dfa7ad17e0ce 2023-11-15 19:54:37,974 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128835fcaf07ee549e6939bee2a45e18666 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128835fcaf07ee549e6939bee2a45e18666 2023-11-15 19:54:37,974 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-15 19:54:37,974 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-15 19:54:37,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:37,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:37,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:37,976 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:37,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 889 msec 2023-11-15 19:54:38,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-15 19:54:38,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:38,446 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-15 19:54:38,447 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-15 19:54:38,447 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-15 19:54:38,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-15 19:54:38,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE}] 2023-11-15 19:54:38,453 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE 2023-11-15 19:54:38,454 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:38,454 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078078454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078078454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078078454"}]},"ts":"1700078078454"} 2023-11-15 19:54:38,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:38,607 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:38,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b18eb7fb184cf7b1796f0be6fae82a7, disabling compactions & flushes 2023-11-15 19:54:38,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:38,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:38,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. after waiting 0 ms 2023-11-15 19:54:38,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:38,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-15 19:54:38,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:38,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:38,613 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 1b18eb7fb184cf7b1796f0be6fae82a7 to self. 2023-11-15 19:54:38,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=CLOSED 2023-11-15 19:54:38,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078078615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078078615"}]},"ts":"1700078078615"} 2023-11-15 19:54:38,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-15 19:54:38,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491 in 161 msec 2023-11-15 19:54:38,618 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=true 2023-11-15 19:54:38,768 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:38,768 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078078768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078078768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078078768"}]},"ts":"1700078078768"} 2023-11-15 19:54:38,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:38,921 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:38,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:38,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b18eb7fb184cf7b1796f0be6fae82a7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:38,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:38,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,925 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,926 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:38,926 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1 2023-11-15 19:54:38,926 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b18eb7fb184cf7b1796f0be6fae82a7 columnFamilyName family1 2023-11-15 19:54:38,931 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/2e4e797cd49749b6a89d56cb38babcbd_SeqId_53_ 2023-11-15 19:54:38,934 DEBUG [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/family1/ffe4101107a549c2a1f8935601aaaec6 2023-11-15 19:54:38,934 INFO [StoreOpener-1b18eb7fb184cf7b1796f0be6fae82a7-1] regionserver.HStore(310): Store=1b18eb7fb184cf7b1796f0be6fae82a7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:38,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:54:38,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b18eb7fb184cf7b1796f0be6fae82a7; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62595353, jitterRate=-0.06725655496120453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:38,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:54:38,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7., pid=53, masterSystemTime=1700078078921 2023-11-15 19:54:38,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:38,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:54:38,941 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=1b18eb7fb184cf7b1796f0be6fae82a7, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:38,941 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700078078941"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078078941"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078078941"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078078941"}]},"ts":"1700078078941"} 2023-11-15 19:54:38,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-15 19:54:38,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 1b18eb7fb184cf7b1796f0be6fae82a7, server=jenkins-hbase4.apache.org,42249,1700078002491 in 173 msec 2023-11-15 19:54:38,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-15 19:54:38,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=1b18eb7fb184cf7b1796f0be6fae82a7, REOPEN/MOVE in 492 msec 2023-11-15 19:54:38,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-15 19:54:38,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 496 msec 2023-11-15 19:54:38,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 911 msec 2023-11-15 19:54:38,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-15 19:54:38,950 INFO [Listener at localhost/43577] compactions.TestMobCompactor(278): alter status finished 2023-11-15 19:54:38,951 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-15 19:54:38,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:38,952 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:38,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:38,953 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078678953 2023-11-15 19:54:38,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:38,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-15 19:54:38,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:38,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x66e85271 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:38,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d35e46d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-15 19:54:38,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-15 19:54:38,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:38,960 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-15 19:54:38,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-11-15 19:54:39,007 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251 (was 251), OpenFileDescriptor=660 (was 640) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=142 (was 189), ProcessCount=174 (was 174), AvailableMemoryMB=924 (was 935) 2023-11-15 19:54:39,018 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=251, OpenFileDescriptor=660, MaxFileDescriptor=60000, SystemLoadAverage=142, ProcessCount=174, AvailableMemoryMB=923 2023-11-15 19:54:39,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-15 19:54:39,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:39,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:54:39,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-15 19:54:39,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:54:39,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-15 19:54:39,023 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:39,024 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec empty. 2023-11-15 19:54:39,024 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:39,024 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-15 19:54:39,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-15 19:54:39,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-15 19:54:39,432 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-15 19:54:39,433 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => aa6ea33808f58f330fd13440573a69ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:54:39,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-15 19:54:39,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:39,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing aa6ea33808f58f330fd13440573a69ec, disabling compactions & flushes 2023-11-15 19:54:39,839 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:39,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:39,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. after waiting 0 ms 2023-11-15 19:54:39,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:39,839 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:39,839 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:39,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:54:39,842 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078079842"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078079842"}]},"ts":"1700078079842"} 2023-11-15 19:54:39,843 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:54:39,844 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:54:39,844 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078079844"}]},"ts":"1700078079844"} 2023-11-15 19:54:39,845 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-15 19:54:39,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, ASSIGN}] 2023-11-15 19:54:39,851 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, ASSIGN 2023-11-15 19:54:39,851 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:54:40,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:40,002 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078080002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078080002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078080002"}]},"ts":"1700078080002"} 2023-11-15 19:54:40,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:40,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-15 19:54:40,155 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:40,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:40,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa6ea33808f58f330fd13440573a69ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:40,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:40,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:40,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:40,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:40,160 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:40,161 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:40,161 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:40,161 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa6ea33808f58f330fd13440573a69ec columnFamilyName family1 2023-11-15 19:54:40,163 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(310): Store=aa6ea33808f58f330fd13440573a69ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:40,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:40,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:40,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:40,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:54:40,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa6ea33808f58f330fd13440573a69ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63268648, jitterRate=-0.05722367763519287}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:40,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:40,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., pid=57, masterSystemTime=1700078080155 2023-11-15 19:54:40,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:40,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:40,171 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:40,171 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078080171"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078080171"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078080171"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078080171"}]},"ts":"1700078080171"} 2023-11-15 19:54:40,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-15 19:54:40,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491 in 169 msec 2023-11-15 19:54:40,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-15 19:54:40,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, ASSIGN in 325 msec 2023-11-15 19:54:40,176 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:54:40,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078080176"}]},"ts":"1700078080176"} 2023-11-15 19:54:40,177 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-15 19:54:40,179 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:54:40,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-11-15 19:54:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-15 19:54:41,127 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-15 19:54:41,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:41,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,151 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:41,152 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:41,152 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:41,152 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:41,152 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,152 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,154 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:41,154 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:41,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:41,154 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:41,154 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,155 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:41,156 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:41,156 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:41,157 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-15 19:54:41,579 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130adbcef0983cc4ebdb59c76d17504f5f0 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130adbcef0983cc4ebdb59c76d17504f5f0 2023-11-15 19:54:41,983 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/d21d1fee1eaa43be98383872940d3837 2023-11-15 19:54:41,987 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/d21d1fee1eaa43be98383872940d3837 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d21d1fee1eaa43be98383872940d3837 2023-11-15 19:54:41,991 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d21d1fee1eaa43be98383872940d3837, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-15 19:54:41,992 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 835ms, sequenceid=5, compaction requested=false 2023-11-15 19:54:41,992 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:41,992 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:41,992 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:41,992 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:41,992 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:41,993 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:41,993 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:41,993 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:41,994 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,994 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:41,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:41,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:41,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:41,995 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,995 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:41,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:41,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:41,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:41,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:41,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f705130[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:41,996 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:41,996 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,998 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:41,999 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:41,999 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:41,999 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:41,999 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:41,999 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:42,000 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:42,000 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,000 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:42,000 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:42,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:42,003 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:42,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:42,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:42,003 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,003 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:42,007 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,007 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:42,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,007 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:42,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:42,008 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,009 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,012 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,012 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,012 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,012 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:42,012 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:42,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:42,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:42,013 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:42,013 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,012 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:42,013 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,013 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,013 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:42,013 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:42,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:42,113 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:42,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:42,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:42,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:42,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,119 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:42,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:42,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:42,119 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:42,120 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,120 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,121 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:42,121 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:42,122 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,122 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,123 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,123 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:42,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:42,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:42,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:42,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:42,124 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-15 19:54:42,285 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:54:42,536 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112838638947fdd14e14ac4d31e9c31e0827 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112838638947fdd14e14ac4d31e9c31e0827 2023-11-15 19:54:42,941 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/0f4ca380597444a186e13aedbcdb1c5d 2023-11-15 19:54:42,946 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/0f4ca380597444a186e13aedbcdb1c5d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/0f4ca380597444a186e13aedbcdb1c5d 2023-11-15 19:54:42,950 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/0f4ca380597444a186e13aedbcdb1c5d, entries=1, sequenceid=9, filesize=5.0 K 2023-11-15 19:54:42,951 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 827ms, sequenceid=9, compaction requested=false 2023-11-15 19:54:42,951 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:42,951 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:42,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:42,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:42,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:42,951 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:42,953 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,953 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:42,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:42,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61e9aa83[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:42,955 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:42,955 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,956 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:42,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:42,956 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:42,957 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,957 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:42,958 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,958 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:42,958 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:42,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:42,961 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:42,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:42,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:42,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,961 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:42,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:42,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:42,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:42,963 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:42,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,965 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,967 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,967 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:42,967 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:42,967 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:42,967 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:42,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:42,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:42,967 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:42,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:42,968 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:42,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:42,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:42,968 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:42,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:42,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,068 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:43,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:43,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:43,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:43,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,074 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:43,074 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:43,074 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:43,074 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:43,074 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,074 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,076 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:43,076 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:43,076 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,076 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:43,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,077 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,077 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:43,077 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:43,077 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:43,078 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:43,490 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a9d4394138a64b76b4e7d4067d68d2e6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a9d4394138a64b76b4e7d4067d68d2e6 2023-11-15 19:54:43,895 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/facefaca74d64919a7660d1e115e12d8 2023-11-15 19:54:43,901 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/facefaca74d64919a7660d1e115e12d8 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/facefaca74d64919a7660d1e115e12d8 2023-11-15 19:54:43,905 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/facefaca74d64919a7660d1e115e12d8, entries=1, sequenceid=13, filesize=5.0 K 2023-11-15 19:54:43,906 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 828ms, sequenceid=13, compaction requested=true 2023-11-15 19:54:43,906 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:43,906 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:43,909 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:43,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:43,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:43,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:43,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dffc509[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:43,911 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:43,911 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,913 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:43,913 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,913 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:43,915 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,915 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:43,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:43,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:43,915 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:43,915 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:43,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:43,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:43,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:43,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:43,917 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:43,917 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:43,917 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:43,917 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,917 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:43,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:43,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:43,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:43,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,921 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,926 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,926 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:43,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:43,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:43,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:43,927 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:43,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:43,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:43,927 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,027 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:44,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:44,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:44,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:44,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,033 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:44,033 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:44,033 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:44,033 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:44,033 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,033 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,037 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:44,037 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:44,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:44,037 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,038 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,038 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,039 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:44,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:44,042 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:44,042 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:44,042 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:44,042 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:44,042 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:44,459 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059af4bc7bda44403f9d2b2d93b06fb92a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059af4bc7bda44403f9d2b2d93b06fb92a 2023-11-15 19:54:44,864 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/52895b76b53f44d0b1211c9d62fbfe8e 2023-11-15 19:54:44,869 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/52895b76b53f44d0b1211c9d62fbfe8e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/52895b76b53f44d0b1211c9d62fbfe8e 2023-11-15 19:54:44,873 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/52895b76b53f44d0b1211c9d62fbfe8e, entries=1, sequenceid=17, filesize=5.0 K 2023-11-15 19:54:44,873 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 831ms, sequenceid=17, compaction requested=true 2023-11-15 19:54:44,873 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:44,873 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:44,873 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:44,874 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:44,874 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,874 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:44,874 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:44,875 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,875 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:44,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:44,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:44,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:44,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:44,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:44,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ec63502[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:44,877 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:44,877 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,878 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,879 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:44,879 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:44,879 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:44,879 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,879 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:44,881 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:44,881 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:44,881 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,882 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:44,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:44,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:44,884 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:44,884 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:44,884 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:44,884 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,884 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:44,885 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,885 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:44,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,885 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:44,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:44,886 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,887 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,889 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,889 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:44,889 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,889 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:44,890 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:44,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:44,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:44,890 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,890 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:44,890 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:44,890 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,890 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:44,890 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,890 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:44,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:44,990 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:44,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:44,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:44,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:44,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,996 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:44,996 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:44,996 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:44,996 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:44,996 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,997 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,998 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,998 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:44,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:44,998 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:44,998 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:44,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,999 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:44,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:44,999 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:44,999 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:45,000 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:45,000 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:45,000 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:45,000 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:45,000 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:45,000 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:45,411 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122882ce6af5c9ae40eb863e5baedb3d9b45 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122882ce6af5c9ae40eb863e5baedb3d9b45 2023-11-15 19:54:45,816 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/14b47c309f0d4efaa352d0162f58fd27 2023-11-15 19:54:45,821 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/14b47c309f0d4efaa352d0162f58fd27 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/14b47c309f0d4efaa352d0162f58fd27 2023-11-15 19:54:45,825 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/14b47c309f0d4efaa352d0162f58fd27, entries=1, sequenceid=21, filesize=5.0 K 2023-11-15 19:54:45,826 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 826ms, sequenceid=21, compaction requested=true 2023-11-15 19:54:45,826 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:45,826 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:45,826 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:45,826 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:45,826 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,826 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:45,826 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:45,828 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,828 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:45,829 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:45,829 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:45,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:45,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7332023b[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:45,830 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:45,830 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,831 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:45,832 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:45,832 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,832 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:45,833 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:45,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:45,835 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:45,835 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:45,835 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:45,835 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,835 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:45,837 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,837 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:45,837 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:45,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:45,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:45,837 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,839 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,842 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:45,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:45,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:45,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:45,843 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:45,842 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:45,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:45,943 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:45,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:45,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:45,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:45,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,948 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:45,948 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:45,948 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:45,948 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:45,949 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,949 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,950 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,950 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:45,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:45,950 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:45,950 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,951 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:45,952 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:45,952 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:45,952 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:46,364 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231117ed3774218446f9c8ea1eae2a4171f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231117ed3774218446f9c8ea1eae2a4171f 2023-11-15 19:54:46,769 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/9b50bcbac2d24bd495e33f7a22f893af 2023-11-15 19:54:46,774 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/9b50bcbac2d24bd495e33f7a22f893af as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/9b50bcbac2d24bd495e33f7a22f893af 2023-11-15 19:54:46,778 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/9b50bcbac2d24bd495e33f7a22f893af, entries=1, sequenceid=25, filesize=5.0 K 2023-11-15 19:54:46,779 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 827ms, sequenceid=25, compaction requested=true 2023-11-15 19:54:46,779 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:46,779 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:46,779 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:46,779 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:46,779 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,779 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:46,779 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:46,781 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,781 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:46,781 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,781 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:46,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:46,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f23136c[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:46,783 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:46,783 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,785 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,785 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:46,785 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:46,785 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:46,785 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,785 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:46,787 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:46,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:46,787 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:46,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:46,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:46,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:46,789 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:46,789 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:46,789 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:46,789 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,790 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:46,791 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,791 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:46,791 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:46,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:46,792 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:46,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,793 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:46,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,795 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,795 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:46,795 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:46,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:46,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:46,795 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:46,795 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:46,795 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,796 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:46,796 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,796 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:46,796 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:46,796 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,796 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:46,896 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:46,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:46,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:46,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:46,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,902 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:46,902 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:46,902 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:46,902 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:46,902 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,902 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,904 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,904 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:46,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:46,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:46,905 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:46,905 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:46,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:46,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,906 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:46,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:46,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:46,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:46,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:46,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:46,906 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:46,906 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:46,906 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:46,906 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:47,323 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012847bb3b78654881a8933531f4f506f8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601012847bb3b78654881a8933531f4f506f8 2023-11-15 19:54:47,729 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/a2cee4a97f5d46cf905b525d1d0d7a40 2023-11-15 19:54:47,734 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/a2cee4a97f5d46cf905b525d1d0d7a40 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/a2cee4a97f5d46cf905b525d1d0d7a40 2023-11-15 19:54:47,738 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/a2cee4a97f5d46cf905b525d1d0d7a40, entries=1, sequenceid=29, filesize=5.0 K 2023-11-15 19:54:47,739 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 833ms, sequenceid=29, compaction requested=true 2023-11-15 19:54:47,739 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:47,739 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:47,741 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,741 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:47,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:47,742 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,742 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:47,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:47,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:47,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:47,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:47,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cd7420c[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:47,743 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:47,743 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,744 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,744 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:47,744 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:47,744 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:47,745 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,745 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:47,746 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:47,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:47,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:47,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:47,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:47,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:47,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:47,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:47,749 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:47,749 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:47,749 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:47,750 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,750 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:47,753 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,753 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:47,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,753 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:47,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:47,753 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:47,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,755 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,757 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,757 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:47,757 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:47,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:47,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:47,758 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:47,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,758 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,858 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:47,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:47,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:47,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:47,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,865 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:47,865 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:47,865 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:47,865 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:47,865 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,865 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,866 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:47,867 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:47,867 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:47,867 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:47,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,868 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:47,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:47,868 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:47,868 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:47,868 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:47,869 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:47,869 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:47,869 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:48,198 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:48,198 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0440f8c5 to 127.0.0.1:50885 2023-11-15 19:54:48,198 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:48,199 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:48,199 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a36c369 to 127.0.0.1:50885 2023-11-15 19:54:48,199 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:48,199 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:48,199 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44204cd8 to 127.0.0.1:50885 2023-11-15 19:54:48,199 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:48,200 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66e85271 to 127.0.0.1:50885 2023-11-15 19:54:48,200 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:48,201 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:48,201 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x660ad282 to 127.0.0.1:50885 2023-11-15 19:54:48,201 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:48,285 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035ba3d8078f5947778ba19d1f1999b683 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035ba3d8078f5947778ba19d1f1999b683 2023-11-15 19:54:48,690 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/005e402d99474a5a8135504c3613cbae 2023-11-15 19:54:48,694 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/005e402d99474a5a8135504c3613cbae as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/005e402d99474a5a8135504c3613cbae 2023-11-15 19:54:48,698 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/005e402d99474a5a8135504c3613cbae, entries=1, sequenceid=33, filesize=5.0 K 2023-11-15 19:54:48,699 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 830ms, sequenceid=33, compaction requested=true 2023-11-15 19:54:48,699 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:48,699 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:48,699 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:48,699 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:48,699 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,699 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:48,699 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:48,701 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,701 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:48,701 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,701 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:48,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:48,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@337606b1[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:48,703 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:48,703 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,707 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,707 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:48,707 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:48,707 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:48,707 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,708 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:48,709 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:48,709 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,709 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,709 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:48,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:48,711 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:48,711 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:48,711 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:48,711 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,711 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:48,713 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,713 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:48,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:48,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,713 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:48,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:48,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:48,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:48,713 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:48,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,715 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:48,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:48,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,717 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:48,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,717 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:48,718 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:48,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:48,818 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:48,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:48,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:48,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:48,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,824 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:48,824 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:48,824 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:48,824 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:48,825 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,825 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,828 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:48,828 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:48,828 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:48,828 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,829 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,830 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:48,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:48,830 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:48,830 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:48,830 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:48,830 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:48,846 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907698a0ddfb52947f0be00b5ecdc9a69b8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907698a0ddfb52947f0be00b5ecdc9a69b8 2023-11-15 19:54:49,251 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/d66b412e76ec496385b9d5b07480a067 2023-11-15 19:54:49,256 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/d66b412e76ec496385b9d5b07480a067 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d66b412e76ec496385b9d5b07480a067 2023-11-15 19:54:49,259 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d66b412e76ec496385b9d5b07480a067, entries=1, sequenceid=37, filesize=5.0 K 2023-11-15 19:54:49,260 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 430ms, sequenceid=37, compaction requested=true 2023-11-15 19:54:49,260 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:49,260 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:49,262 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,262 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:49,263 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:49,263 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:49,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:49,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5036e93e[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:49,264 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:49,264 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,266 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:49,266 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,266 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:49,266 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:49,267 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:49,267 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:49,267 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,267 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:49,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:49,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:49,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:49,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:49,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:49,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:49,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:49,270 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:49,270 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:49,270 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:49,270 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,270 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:49,272 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,272 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:49,272 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:49,272 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:49,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,273 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,277 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:49,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:49,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,277 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,278 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,278 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:49,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:49,278 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:49,378 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:49,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:49,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:54:49,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-15 19:54:49,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,383 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:49,384 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:49,384 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-15 19:54:49,384 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-15 19:54:49,384 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,384 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,385 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:49,385 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:49,386 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:49,386 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:54:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:54:49,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,387 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-15 19:54:49,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:49,387 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-15 19:54:49,387 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:54:49,387 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-15 19:54:49,387 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:54:49,387 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:54:49,387 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:49,387 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. started... 2023-11-15 19:54:49,387 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa6ea33808f58f330fd13440573a69ec 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:54:49,798 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202952cb615ad842dfbb880039a00cf912 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202952cb615ad842dfbb880039a00cf912 2023-11-15 19:54:50,203 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/7730c6bac24e473f95676158af31db89 2023-11-15 19:54:50,209 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/7730c6bac24e473f95676158af31db89 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/7730c6bac24e473f95676158af31db89 2023-11-15 19:54:50,213 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/7730c6bac24e473f95676158af31db89, entries=1, sequenceid=41, filesize=5.0 K 2023-11-15 19:54:50,214 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa6ea33808f58f330fd13440573a69ec in 827ms, sequenceid=41, compaction requested=true 2023-11-15 19:54:50,214 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:50,214 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:50,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:54:50,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:54:50,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-15 19:54:50,214 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-15 19:54:50,216 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,216 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:50,217 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,217 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:54:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:50,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-15 19:54:50,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17c93827[Count = 0] remaining members to acquire global barrier 2023-11-15 19:54:50,218 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-15 19:54:50,218 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,219 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-15 19:54:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-15 19:54:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:54:50,220 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,220 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:54:50,222 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:50,222 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-15 19:54:50,222 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:50,222 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-15 19:54:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:50,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:50,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:54:50,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-15 19:54:50,225 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-15 19:54:50,225 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:54:50,225 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:54:50,225 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,225 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:54:50,228 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,228 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:54:50,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,229 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:54:50,229 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:54:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,230 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:54:50,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,232 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-15 19:54:50,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:54:50,233 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:54:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,233 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:54:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:54:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:54:50,333 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:54:50,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:54:50,335 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:50,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:50,337 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:50,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:50,337 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078690337 2023-11-15 19:54:50,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:50,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-15 19:54:50,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:50,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x3ae48251 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@359ca06f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:50,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,189 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010383807b8c8f1746bf8d52a5aa667967d6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010383807b8c8f1746bf8d52a5aa667967d6 2023-11-15 19:54:51,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:51,203 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:51,204 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:51,210 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:51,211 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:51,218 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0a44e90dd7274abab1a622a34469bc55 first=Optional[r3] last=Optional[r6] 2023-11-15 19:54:51,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0a44e90dd7274abab1a622a34469bc55}] 2023-11-15 19:54:51,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0a44e90dd7274abab1a622a34469bc55 for inclusion in aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:51,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-15 19:54:51,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:51,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:51,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0a44e90dd7274abab1a622a34469bc55 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kiq592r807q8i8sggl2odniokdklii52enqebisifihto95n005bl9akb4qq2hu3/family1/0a44e90dd7274abab1a622a34469bc55 2023-11-15 19:54:51,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kiq592r807q8i8sggl2odniokdklii52enqebisifihto95n005bl9akb4qq2hu3/family1/0a44e90dd7274abab1a622a34469bc55 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_ 2023-11-15 19:54:51,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kiq592r807q8i8sggl2odniokdklii52enqebisifihto95n005bl9akb4qq2hu3/family1/0a44e90dd7274abab1a622a34469bc55 into aa6ea33808f58f330fd13440573a69ec/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_ - updating store file list. 2023-11-15 19:54:51,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_ into aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:51,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kiq592r807q8i8sggl2odniokdklii52enqebisifihto95n005bl9akb4qq2hu3/family1/0a44e90dd7274abab1a622a34469bc55 into aa6ea33808f58f330fd13440573a69ec/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_) 2023-11-15 19:54:51,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__kiq592r807q8i8sggl2odniokdklii52enqebisifihto95n005bl9akb4qq2hu3/family1/0a44e90dd7274abab1a622a34469bc55 2023-11-15 19:54:51,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-15 19:54:51,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-15 19:54:51,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): aa6ea33808f58f330fd13440573a69ec/family1 is initiating minor compaction 2023-11-15 19:54:51,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@18ed8f31; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:51,233 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of aa6ea33808f58f330fd13440573a69ec/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:51,233 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/0f4ca380597444a186e13aedbcdb1c5d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/facefaca74d64919a7660d1e115e12d8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/52895b76b53f44d0b1211c9d62fbfe8e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/14b47c309f0d4efaa352d0162f58fd27, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/9b50bcbac2d24bd495e33f7a22f893af, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/a2cee4a97f5d46cf905b525d1d0d7a40, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/005e402d99474a5a8135504c3613cbae, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d66b412e76ec496385b9d5b07480a067, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/7730c6bac24e473f95676158af31db89, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp, totalSize=50.3 K 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 0f4ca380597444a186e13aedbcdb1c5d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting facefaca74d64919a7660d1e115e12d8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 52895b76b53f44d0b1211c9d62fbfe8e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 14b47c309f0d4efaa352d0162f58fd27, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 9b50bcbac2d24bd495e33f7a22f893af, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting a2cee4a97f5d46cf905b525d1d0d7a40, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 005e402d99474a5a8135504c3613cbae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting d66b412e76ec496385b9d5b07480a067, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 7730c6bac24e473f95676158af31db89, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-15 19:54:51,234 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-15 19:54:51,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:51,235 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:51,237 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122882ce6af5c9ae40eb863e5baedb3d9b45 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122882ce6af5c9ae40eb863e5baedb3d9b45 2023-11-15 19:54:51,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231117ed3774218446f9c8ea1eae2a4171f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231117ed3774218446f9c8ea1eae2a4171f 2023-11-15 19:54:51,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601012847bb3b78654881a8933531f4f506f8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601012847bb3b78654881a8933531f4f506f8 2023-11-15 19:54:51,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035ba3d8078f5947778ba19d1f1999b683 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035ba3d8078f5947778ba19d1f1999b683 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-15 19:54:51,241 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:51,262 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): aa6ea33808f58f330fd13440573a69ec#family1#compaction#72 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:52,077 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/01bac57d0e904f6ba3c28e6fd12774d1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/01bac57d0e904f6ba3c28e6fd12774d1 2023-11-15 19:54:52,082 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in aa6ea33808f58f330fd13440573a69ec/family1 of aa6ea33808f58f330fd13440573a69ec into 01bac57d0e904f6ba3c28e6fd12774d1(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:54:52,082 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:52,082 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700078091233; duration=0sec 2023-11-15 19:54:52,082 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:52,085 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120568ba880cd6be446d9212edbf74881a48 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120568ba880cd6be446d9212edbf74881a48 2023-11-15 19:54:52,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:52,107 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b049cf9770b4f569b72ab629061ebe6 first=Optional[r00] last=Optional[r2] 2023-11-15 19:54:52,108 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b049cf9770b4f569b72ab629061ebe6}] 2023-11-15 19:54:52,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b049cf9770b4f569b72ab629061ebe6 for inclusion in aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:52,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-15 19:54:52,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:52,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:52,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b049cf9770b4f569b72ab629061ebe6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sq2nqnqfbmer74o2i95i535jlrv16e51aqv2s5pl29pu7rhtv3dd8eh2oc7sbe5/family1/8b049cf9770b4f569b72ab629061ebe6 2023-11-15 19:54:52,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sq2nqnqfbmer74o2i95i535jlrv16e51aqv2s5pl29pu7rhtv3dd8eh2oc7sbe5/family1/8b049cf9770b4f569b72ab629061ebe6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_ 2023-11-15 19:54:52,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sq2nqnqfbmer74o2i95i535jlrv16e51aqv2s5pl29pu7rhtv3dd8eh2oc7sbe5/family1/8b049cf9770b4f569b72ab629061ebe6 into aa6ea33808f58f330fd13440573a69ec/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_ - updating store file list. 2023-11-15 19:54:52,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_ into aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:52,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sq2nqnqfbmer74o2i95i535jlrv16e51aqv2s5pl29pu7rhtv3dd8eh2oc7sbe5/family1/8b049cf9770b4f569b72ab629061ebe6 into aa6ea33808f58f330fd13440573a69ec/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_) 2023-11-15 19:54:52,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sq2nqnqfbmer74o2i95i535jlrv16e51aqv2s5pl29pu7rhtv3dd8eh2oc7sbe5/family1/8b049cf9770b4f569b72ab629061ebe6 2023-11-15 19:54:52,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-15 19:54:52,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-15 19:54:52,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): aa6ea33808f58f330fd13440573a69ec/family1 is initiating minor compaction (all files) 2023-11-15 19:54:52,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@580a1ac3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:52,120 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of aa6ea33808f58f330fd13440573a69ec/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:52,120 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d21d1fee1eaa43be98383872940d3837, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/01bac57d0e904f6ba3c28e6fd12774d1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp, totalSize=388.1 K 2023-11-15 19:54:52,121 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting d21d1fee1eaa43be98383872940d3837, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826299 2023-11-15 19:54:52,121 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 01bac57d0e904f6ba3c28e6fd12774d1, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226299 2023-11-15 19:54:52,121 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878826299 2023-11-15 19:54:52,122 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:52,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:52,124 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130adbcef0983cc4ebdb59c76d17504f5f0 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130adbcef0983cc4ebdb59c76d17504f5f0 2023-11-15 19:54:52,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a9d4394138a64b76b4e7d4067d68d2e6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a9d4394138a64b76b4e7d4067d68d2e6 2023-11-15 19:54:52,126 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059af4bc7bda44403f9d2b2d93b06fb92a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059af4bc7bda44403f9d2b2d93b06fb92a 2023-11-15 19:54:52,126 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-15 19:54:52,126 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-15 19:54:52,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:52,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:52,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:52,128 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:52,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7920 sec 2023-11-15 19:54:52,144 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): aa6ea33808f58f330fd13440573a69ec#family1#compaction#73 average throughput is 11.98 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:52,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/0f4ca380597444a186e13aedbcdb1c5d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/facefaca74d64919a7660d1e115e12d8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/52895b76b53f44d0b1211c9d62fbfe8e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/14b47c309f0d4efaa352d0162f58fd27, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/9b50bcbac2d24bd495e33f7a22f893af, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/a2cee4a97f5d46cf905b525d1d0d7a40, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/005e402d99474a5a8135504c3613cbae, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d66b412e76ec496385b9d5b07480a067, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/7730c6bac24e473f95676158af31db89, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_] to archive 2023-11-15 19:54:52,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:52,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/0f4ca380597444a186e13aedbcdb1c5d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/0f4ca380597444a186e13aedbcdb1c5d 2023-11-15 19:54:52,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/facefaca74d64919a7660d1e115e12d8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/facefaca74d64919a7660d1e115e12d8 2023-11-15 19:54:52,166 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-15 19:54:52,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/52895b76b53f44d0b1211c9d62fbfe8e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/52895b76b53f44d0b1211c9d62fbfe8e 2023-11-15 19:54:52,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/14b47c309f0d4efaa352d0162f58fd27 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/14b47c309f0d4efaa352d0162f58fd27 2023-11-15 19:54:52,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/9b50bcbac2d24bd495e33f7a22f893af to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/9b50bcbac2d24bd495e33f7a22f893af 2023-11-15 19:54:52,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/a2cee4a97f5d46cf905b525d1d0d7a40 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/a2cee4a97f5d46cf905b525d1d0d7a40 2023-11-15 19:54:52,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/005e402d99474a5a8135504c3613cbae to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/005e402d99474a5a8135504c3613cbae 2023-11-15 19:54:52,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d66b412e76ec496385b9d5b07480a067 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d66b412e76ec496385b9d5b07480a067 2023-11-15 19:54:52,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/7730c6bac24e473f95676158af31db89 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/7730c6bac24e473f95676158af31db89 2023-11-15 19:54:52,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/b1bc0655fbea43dcb7396baaf2ed163f_SeqId_44_ 2023-11-15 19:54:52,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-15 19:54:52,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:52,619 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-15 19:54:52,620 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-15 19:54:52,620 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-15 19:54:52,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-15 19:54:52,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE}] 2023-11-15 19:54:52,624 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE 2023-11-15 19:54:52,625 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:52,625 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078092625"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078092625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078092625"}]},"ts":"1700078092625"} 2023-11-15 19:54:52,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:52,778 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:52,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:52,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa6ea33808f58f330fd13440573a69ec, disabling compactions & flushes 2023-11-15 19:54:52,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,363 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/.tmp/family1/30651eeccc6b454d801b16c4792b0eaf as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/30651eeccc6b454d801b16c4792b0eaf 2023-11-15 19:54:53,367 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in aa6ea33808f58f330fd13440573a69ec/family1 of aa6ea33808f58f330fd13440573a69ec into 30651eeccc6b454d801b16c4792b0eaf(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:54:53,367 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:53,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,367 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1700078092120; duration=1sec 2023-11-15 19:54:53,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. after waiting 0 ms 2023-11-15 19:54:53,367 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:53,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,370 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d21d1fee1eaa43be98383872940d3837, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/01bac57d0e904f6ba3c28e6fd12774d1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_] to archive 2023-11-15 19:54:53,370 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:53,372 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d21d1fee1eaa43be98383872940d3837 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/d21d1fee1eaa43be98383872940d3837 2023-11-15 19:54:53,373 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/01bac57d0e904f6ba3c28e6fd12774d1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/01bac57d0e904f6ba3c28e6fd12774d1 2023-11-15 19:54:53,374 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/c0a79f0d07ce4cd3b7b863544e8e6bc9_SeqId_47_ 2023-11-15 19:54:53,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-15 19:54:53,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:53,379 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: aa6ea33808f58f330fd13440573a69ec to self. 2023-11-15 19:54:53,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,380 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=CLOSED 2023-11-15 19:54:53,380 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078093380"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078093380"}]},"ts":"1700078093380"} 2023-11-15 19:54:53,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-15 19:54:53,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491 in 755 msec 2023-11-15 19:54:53,383 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=true 2023-11-15 19:54:53,533 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:53,533 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078093533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078093533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078093533"}]},"ts":"1700078093533"} 2023-11-15 19:54:53,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:53,686 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:53,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa6ea33808f58f330fd13440573a69ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:53,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:53,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,690 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,691 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:53,691 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:53,691 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa6ea33808f58f330fd13440573a69ec columnFamilyName family1 2023-11-15 19:54:53,696 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/30651eeccc6b454d801b16c4792b0eaf 2023-11-15 19:54:53,697 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(310): Store=aa6ea33808f58f330fd13440573a69ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:53,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:53,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa6ea33808f58f330fd13440573a69ec; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70692181, jitterRate=0.0533955842256546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:53,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:53,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., pid=63, masterSystemTime=1700078093686 2023-11-15 19:54:53,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:53,705 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:53,705 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078093704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078093704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078093704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078093704"}]},"ts":"1700078093704"} 2023-11-15 19:54:53,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-15 19:54:53,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491 in 172 msec 2023-11-15 19:54:53,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-15 19:54:53,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE in 1.0830 sec 2023-11-15 19:54:53,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-15 19:54:53,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0870 sec 2023-11-15 19:54:53,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5010 sec 2023-11-15 19:54:53,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-15 19:54:53,712 INFO [Listener at localhost/43577] compactions.TestMobCompactor(278): alter status finished 2023-11-15 19:54:53,713 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:53,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:53,715 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:53,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:53,715 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078693715 2023-11-15 19:54:53,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:53,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-15 19:54:53,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:53,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x0d2c07fa to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:53,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cd5772d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:53,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:53,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:53,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:53,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:53,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:54,146 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283427ddcdc6134a2eb3cabf2e84095b57 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283427ddcdc6134a2eb3cabf2e84095b57 2023-11-15 19:54:54,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:54,159 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:54,160 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:54,166 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:54,167 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:54,175 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cae7e8dd86624119ac66f3624198805f first=Optional[r05] last=Optional[r8] 2023-11-15 19:54:54,176 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=51 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cae7e8dd86624119ac66f3624198805f}] 2023-11-15 19:54:54,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cae7e8dd86624119ac66f3624198805f for inclusion in aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-15 19:54:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:54,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cae7e8dd86624119ac66f3624198805f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fctkcpg2s9s8ek4hgic3apk869a2pm5b2f2oi4ro5vlscmh90f6vr2lp15bitnan/family1/cae7e8dd86624119ac66f3624198805f 2023-11-15 19:54:54,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fctkcpg2s9s8ek4hgic3apk869a2pm5b2f2oi4ro5vlscmh90f6vr2lp15bitnan/family1/cae7e8dd86624119ac66f3624198805f as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/186e25fb5ec743beb7ef4d1363644870_SeqId_53_ 2023-11-15 19:54:54,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fctkcpg2s9s8ek4hgic3apk869a2pm5b2f2oi4ro5vlscmh90f6vr2lp15bitnan/family1/cae7e8dd86624119ac66f3624198805f into aa6ea33808f58f330fd13440573a69ec/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/186e25fb5ec743beb7ef4d1363644870_SeqId_53_ - updating store file list. 2023-11-15 19:54:54,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/186e25fb5ec743beb7ef4d1363644870_SeqId_53_ into aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:54,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fctkcpg2s9s8ek4hgic3apk869a2pm5b2f2oi4ro5vlscmh90f6vr2lp15bitnan/family1/cae7e8dd86624119ac66f3624198805f into aa6ea33808f58f330fd13440573a69ec/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/186e25fb5ec743beb7ef4d1363644870_SeqId_53_) 2023-11-15 19:54:54,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fctkcpg2s9s8ek4hgic3apk869a2pm5b2f2oi4ro5vlscmh90f6vr2lp15bitnan/family1/cae7e8dd86624119ac66f3624198805f 2023-11-15 19:54:54,191 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:54,192 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:54,193 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202952cb615ad842dfbb880039a00cf912 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202952cb615ad842dfbb880039a00cf912 2023-11-15 19:54:54,194 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112838638947fdd14e14ac4d31e9c31e0827 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112838638947fdd14e14ac4d31e9c31e0827 2023-11-15 19:54:54,194 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-15 19:54:54,194 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-15 19:54:54,195 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:54,195 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:54,195 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:54,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:54,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:54,196 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:54,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 482 msec 2023-11-15 19:54:54,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-15 19:54:54,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:54,661 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-15 19:54:54,662 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-15 19:54:54,662 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-15 19:54:54,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-15 19:54:54,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE}] 2023-11-15 19:54:54,666 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE 2023-11-15 19:54:54,667 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:54,667 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078094667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078094667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078094667"}]},"ts":"1700078094667"} 2023-11-15 19:54:54,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:54,819 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:54,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:54,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa6ea33808f58f330fd13440573a69ec, disabling compactions & flushes 2023-11-15 19:54:54,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:54,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:54,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. after waiting 0 ms 2023-11-15 19:54:54,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:54,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-15 19:54:54,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:54,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:54,825 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: aa6ea33808f58f330fd13440573a69ec to self. 2023-11-15 19:54:54,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:54,827 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=CLOSED 2023-11-15 19:54:54,827 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078094827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078094827"}]},"ts":"1700078094827"} 2023-11-15 19:54:54,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-15 19:54:54,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491 in 160 msec 2023-11-15 19:54:54,829 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=true 2023-11-15 19:54:54,980 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:54,980 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078094980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078094980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078094980"}]},"ts":"1700078094980"} 2023-11-15 19:54:54,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:55,133 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:55,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:55,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa6ea33808f58f330fd13440573a69ec, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:55,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:55,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:55,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:55,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:55,137 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:55,138 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:55,138 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1 2023-11-15 19:54:55,139 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa6ea33808f58f330fd13440573a69ec columnFamilyName family1 2023-11-15 19:54:55,144 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/186e25fb5ec743beb7ef4d1363644870_SeqId_53_ 2023-11-15 19:54:55,146 DEBUG [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/family1/30651eeccc6b454d801b16c4792b0eaf 2023-11-15 19:54:55,146 INFO [StoreOpener-aa6ea33808f58f330fd13440573a69ec-1] regionserver.HStore(310): Store=aa6ea33808f58f330fd13440573a69ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:55,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:55,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:55,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:54:55,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa6ea33808f58f330fd13440573a69ec; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61967986, jitterRate=-0.07660505175590515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:55,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:54:55,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec., pid=69, masterSystemTime=1700078095133 2023-11-15 19:54:55,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:55,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:54:55,153 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=aa6ea33808f58f330fd13440573a69ec, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:55,153 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700078095153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078095153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078095153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078095153"}]},"ts":"1700078095153"} 2023-11-15 19:54:55,154 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38755] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase4.apache.org,42249,1700078002491, table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-15 19:54:55,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-15 19:54:55,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure aa6ea33808f58f330fd13440573a69ec, server=jenkins-hbase4.apache.org,42249,1700078002491 in 172 msec 2023-11-15 19:54:55,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-15 19:54:55,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=aa6ea33808f58f330fd13440573a69ec, REOPEN/MOVE in 490 msec 2023-11-15 19:54:55,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-15 19:54:55,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 494 msec 2023-11-15 19:54:55,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 906 msec 2023-11-15 19:54:55,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-15 19:54:55,162 INFO [Listener at localhost/43577] compactions.TestMobCompactor(278): alter status finished 2023-11-15 19:54:55,163 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-15 19:54:55,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:55,165 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:55,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:55,166 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078695166 2023-11-15 19:54:55,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:54:55,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-15 19:54:55,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:55,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x5316be85 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:55,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e0920ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:55,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,174 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-15 19:54:55,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-15 19:54:55,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:55,174 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-15 19:54:55,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-15 19:54:55,223 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=245 (was 251), OpenFileDescriptor=649 (was 660), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=111 (was 142), ProcessCount=169 (was 174), AvailableMemoryMB=889 (was 923) 2023-11-15 19:54:55,235 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=245, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=111, ProcessCount=169, AvailableMemoryMB=888 2023-11-15 19:54:55,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-15 19:54:55,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-15 19:54:55,241 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:54:55,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-15 19:54:55,242 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:54:55,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-15 19:54:55,243 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:55,243 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2 empty. 2023-11-15 19:54:55,243 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:55,244 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-15 19:54:55,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-15 19:54:55,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-15 19:54:55,651 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-15 19:54:55,653 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 87e1449f26b0cb7486b6d0986bc681a2, NAME => 'testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:54:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-15 19:54:56,058 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:56,058 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 87e1449f26b0cb7486b6d0986bc681a2, disabling compactions & flushes 2023-11-15 19:54:56,058 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:56,058 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:56,059 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. after waiting 0 ms 2023-11-15 19:54:56,059 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:56,059 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:56,059 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 87e1449f26b0cb7486b6d0986bc681a2: 2023-11-15 19:54:56,061 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:54:56,061 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700078096061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078096061"}]},"ts":"1700078096061"} 2023-11-15 19:54:56,063 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:54:56,063 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:54:56,063 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078096063"}]},"ts":"1700078096063"} 2023-11-15 19:54:56,064 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-15 19:54:56,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=87e1449f26b0cb7486b6d0986bc681a2, ASSIGN}] 2023-11-15 19:54:56,069 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=87e1449f26b0cb7486b6d0986bc681a2, ASSIGN 2023-11-15 19:54:56,069 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=87e1449f26b0cb7486b6d0986bc681a2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:54:56,220 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=87e1449f26b0cb7486b6d0986bc681a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:56,220 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700078096220"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078096220"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078096220"}]},"ts":"1700078096220"} 2023-11-15 19:54:56,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 87e1449f26b0cb7486b6d0986bc681a2, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:54:56,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-15 19:54:56,373 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:56,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:56,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87e1449f26b0cb7486b6d0986bc681a2, NAME => 'testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:54:56,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-15 19:54:56,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-15 19:54:56,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:56,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:54:56,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:56,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:56,379 INFO [StoreOpener-87e1449f26b0cb7486b6d0986bc681a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:56,380 DEBUG [StoreOpener-87e1449f26b0cb7486b6d0986bc681a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1 2023-11-15 19:54:56,380 DEBUG [StoreOpener-87e1449f26b0cb7486b6d0986bc681a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1 2023-11-15 19:54:56,380 INFO [StoreOpener-87e1449f26b0cb7486b6d0986bc681a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87e1449f26b0cb7486b6d0986bc681a2 columnFamilyName f1 2023-11-15 19:54:56,381 INFO [StoreOpener-87e1449f26b0cb7486b6d0986bc681a2-1] regionserver.HStore(310): Store=87e1449f26b0cb7486b6d0986bc681a2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:54:56,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:56,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:56,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:54:56,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:54:56,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87e1449f26b0cb7486b6d0986bc681a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68583110, jitterRate=0.021967977285385132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:54:56,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87e1449f26b0cb7486b6d0986bc681a2: 2023-11-15 19:54:56,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2., pid=73, masterSystemTime=1700078096373 2023-11-15 19:54:56,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:56,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:56,389 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=87e1449f26b0cb7486b6d0986bc681a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:54:56,389 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700078096389"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078096389"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078096389"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078096389"}]},"ts":"1700078096389"} 2023-11-15 19:54:56,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-15 19:54:56,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 87e1449f26b0cb7486b6d0986bc681a2, server=jenkins-hbase4.apache.org,42249,1700078002491 in 169 msec 2023-11-15 19:54:56,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-15 19:54:56,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=87e1449f26b0cb7486b6d0986bc681a2, ASSIGN in 325 msec 2023-11-15 19:54:56,393 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:54:56,393 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078096393"}]},"ts":"1700078096393"} 2023-11-15 19:54:56,394 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-15 19:54:56,397 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:54:56,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-11-15 19:54:57,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-15 19:54:57,346 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-15 19:54:57,346 DEBUG [Listener at localhost/43577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-15 19:54:57,348 INFO [Listener at localhost/43577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-15 19:54:57,351 INFO [Listener at localhost/43577] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-15 19:54:57,351 INFO [Listener at localhost/43577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-15 19:54:57,351 INFO [Listener at localhost/43577] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-15 19:54:57,355 INFO [Listener at localhost/43577] regionserver.HRegion(2745): Flushing 87e1449f26b0cb7486b6d0986bc681a2 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-15 19:54:57,776 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115f95ef767823247878769a0a6983a63a1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231115f95ef767823247878769a0a6983a63a1 2023-11-15 19:54:57,916 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5316be85 to 127.0.0.1:50885 2023-11-15 19:54:57,916 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:57,916 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:57,916 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d2c07fa to 127.0.0.1:50885 2023-11-15 19:54:57,916 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-15 19:54:57,916 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:57,917 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:54:57,917 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ae48251 to 127.0.0.1:50885 2023-11-15 19:54:57,917 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:54:58,321 INFO [Listener at localhost/43577] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/.tmp/f1/a7cbecb9ff0246ca87ad93f7fae213fd 2023-11-15 19:54:58,327 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/.tmp/f1/a7cbecb9ff0246ca87ad93f7fae213fd as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd 2023-11-15 19:54:58,330 INFO [Listener at localhost/43577] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd, entries=1, sequenceid=5, filesize=4.9 K 2023-11-15 19:54:58,332 INFO [Listener at localhost/43577] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 87e1449f26b0cb7486b6d0986bc681a2 in 977ms, sequenceid=5, compaction requested=false 2023-11-15 19:54:58,332 DEBUG [Listener at localhost/43577] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-15 19:54:58,333 DEBUG [Listener at localhost/43577] regionserver.HRegion(2446): Flush status journal for 87e1449f26b0cb7486b6d0986bc681a2: 2023-11-15 19:54:58,335 INFO [Listener at localhost/43577] regionserver.HRegion(2745): Flushing 87e1449f26b0cb7486b6d0986bc681a2 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-15 19:54:58,345 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115c9fee085d714463eb710be1cdca1338d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231115c9fee085d714463eb710be1cdca1338d 2023-11-15 19:54:58,749 INFO [Listener at localhost/43577] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/.tmp/f1/3466404ea27e4f16b004793eeaff9af7 2023-11-15 19:54:58,754 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/.tmp/f1/3466404ea27e4f16b004793eeaff9af7 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7 2023-11-15 19:54:58,757 INFO [Listener at localhost/43577] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7, entries=1, sequenceid=9, filesize=4.9 K 2023-11-15 19:54:58,758 INFO [Listener at localhost/43577] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 87e1449f26b0cb7486b6d0986bc681a2 in 423ms, sequenceid=9, compaction requested=false 2023-11-15 19:54:58,758 DEBUG [Listener at localhost/43577] regionserver.HRegion(2446): Flush status journal for 87e1449f26b0cb7486b6d0986bc681a2: 2023-11-15 19:54:58,760 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-15 19:54:58,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-15 19:54:58,761 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-15 19:54:58,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:58,762 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078698762 2023-11-15 19:54:58,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-15 19:54:58,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-15 19:54:58,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-15 19:54:58,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x34b14ba5 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:54:58,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53d8138d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:54:58,768 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231115 for table='testGetAfterCompaction' and column='f1' 2023-11-15 19:54:58,811 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:58,811 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:58,861 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:58,862 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:58,912 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:58,912 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:58,915 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:54:58,963 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:58,963 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,014 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,014 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,065 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,065 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,115 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,116 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,166 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,166 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,217 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,217 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,267 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,267 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,318 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,318 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,369 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,369 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,419 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,419 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,470 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,470 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,521 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,521 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,571 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,571 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,590 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111596f3dcb4cf61468bb973216933a8f94c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111596f3dcb4cf61468bb973216933a8f94c 2023-11-15 19:54:59,591 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testGetAfterCompaction' column='f1' 2023-11-15 19:54:59,604 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:54:59,605 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:54:59,611 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:54:59,612 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:54:59,620 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/f1/b58f07449aaa4c60bf1fd376e43df4c3 first=Optional[r1] last=Optional[r2] 2023-11-15 19:54:59,621 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{f1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/f1/b58f07449aaa4c60bf1fd376e43df4c3}] 2023-11-15 19:54:59,622 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,622 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/f1/b58f07449aaa4c60bf1fd376e43df4c3 for inclusion in 87e1449f26b0cb7486b6d0986bc681a2/f1 2023-11-15 19:54:59,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-15 19:54:59,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:54:59,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 87e1449f26b0cb7486b6d0986bc681a2: 2023-11-15 19:54:59,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/f1/b58f07449aaa4c60bf1fd376e43df4c3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testGetAfterCompaction__jh84qa5cq2ch5i11aktpglsr6od0ojeviv7lprkh8u59rfc1lqvqe746hmnfntr7/f1/b58f07449aaa4c60bf1fd376e43df4c3 2023-11-15 19:54:59,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testGetAfterCompaction__jh84qa5cq2ch5i11aktpglsr6od0ojeviv7lprkh8u59rfc1lqvqe746hmnfntr7/f1/b58f07449aaa4c60bf1fd376e43df4c3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_ 2023-11-15 19:54:59,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testGetAfterCompaction__jh84qa5cq2ch5i11aktpglsr6od0ojeviv7lprkh8u59rfc1lqvqe746hmnfntr7/f1/b58f07449aaa4c60bf1fd376e43df4c3 into 87e1449f26b0cb7486b6d0986bc681a2/f1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_ - updating store file list. 2023-11-15 19:54:59,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_ into 87e1449f26b0cb7486b6d0986bc681a2/f1 2023-11-15 19:54:59,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testGetAfterCompaction__jh84qa5cq2ch5i11aktpglsr6od0ojeviv7lprkh8u59rfc1lqvqe746hmnfntr7/f1/b58f07449aaa4c60bf1fd376e43df4c3 into 87e1449f26b0cb7486b6d0986bc681a2/f1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_) 2023-11-15 19:54:59,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testGetAfterCompaction__jh84qa5cq2ch5i11aktpglsr6od0ojeviv7lprkh8u59rfc1lqvqe746hmnfntr7/f1/b58f07449aaa4c60bf1fd376e43df4c3 2023-11-15 19:54:59,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 87e1449f26b0cb7486b6d0986bc681a2/f1 is initiating minor compaction 2023-11-15 19:54:59,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5807ebe0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:54:59,634 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 87e1449f26b0cb7486b6d0986bc681a2/f1 in testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:59,634 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/.tmp, totalSize=10.0 K 2023-11-15 19:54:59,634 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3466404ea27e4f16b004793eeaff9af7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:54:59,634 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3751b665c3fb47e08515f89591184430_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:54:59,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testGetAfterCompaction' column='f1' 2023-11-15 19:54:59,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:54:59,637 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231115c9fee085d714463eb710be1cdca1338d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231115c9fee085d714463eb710be1cdca1338d 2023-11-15 19:54:59,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231115f95ef767823247878769a0a6983a63a1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231115f95ef767823247878769a0a6983a63a1 2023-11-15 19:54:59,638 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-15 19:54:59,638 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231115' 2023-11-15 19:54:59,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231115 for table='testGetAfterCompaction' and column='f1' 2023-11-15 19:54:59,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-15 19:54:59,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:54:59,640 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-15 19:54:59,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 880 msec 2023-11-15 19:54:59,641 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 87e1449f26b0cb7486b6d0986bc681a2#f1#compaction#76 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:54:59,673 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,673 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:54:59,673 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,676 DEBUG [Listener at localhost/43577] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-15 19:54:59,679 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-15 19:54:59,679 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42249] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:54:59,680 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-15 19:54:59,680 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-15 19:54:59,680 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42249] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-15 19:54:59,680 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42249] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. because compaction request was cancelled 2023-11-15 19:54:59,731 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,732 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:54:59,732 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,782 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,782 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:54:59,782 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,833 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,833 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:54:59,833 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,884 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,884 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:54:59,884 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,935 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,935 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:54:59,935 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,986 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:54:59,986 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:54:59,986 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,037 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,037 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,037 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,087 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,088 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,088 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,138 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,138 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,139 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,189 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,189 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,189 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,240 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,240 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,240 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,291 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,291 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,291 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,342 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,342 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,342 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,393 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,393 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,393 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,443 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,444 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,444 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,454 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/.tmp/f1/1e029a73944143d19c5c0ea3fe538424 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/1e029a73944143d19c5c0ea3fe538424 2023-11-15 19:55:00,458 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 87e1449f26b0cb7486b6d0986bc681a2/f1 of 87e1449f26b0cb7486b6d0986bc681a2 into 1e029a73944143d19c5c0ea3fe538424(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:55:00,458 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 87e1449f26b0cb7486b6d0986bc681a2: 2023-11-15 19:55:00,458 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700078099633; duration=0sec 2023-11-15 19:55:00,458 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:55:00,494 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/1e029a73944143d19c5c0ea3fe538424; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700078100449; access_time=1700078099639; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,494 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098749; access_time=1700078098336; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,494 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700078099587; access_time=1700078098779; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-15 19:55:00,494 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_] to archive 2023-11-15 19:55:00,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:00,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3466404ea27e4f16b004793eeaff9af7 2023-11-15 19:55:00,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/3751b665c3fb47e08515f89591184430_SeqId_12_ 2023-11-15 19:55:00,545 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/1e029a73944143d19c5c0ea3fe538424; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700078100449; access_time=1700078099639; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,545 INFO [Listener at localhost/43577] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700078098321; access_time=1700078097358; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-15 19:55:00,663 INFO [Listener at localhost/43577] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-15 19:55:00,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-15 19:55:00,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-15 19:55:00,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078100678"}]},"ts":"1700078100678"} 2023-11-15 19:55:00,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-15 19:55:00,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-15 19:55:00,682 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-15 19:55:00,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=87e1449f26b0cb7486b6d0986bc681a2, UNASSIGN}] 2023-11-15 19:55:00,684 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=87e1449f26b0cb7486b6d0986bc681a2, UNASSIGN 2023-11-15 19:55:00,685 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=87e1449f26b0cb7486b6d0986bc681a2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:00,685 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700078100685"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078100685"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078100685"}]},"ts":"1700078100685"} 2023-11-15 19:55:00,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 87e1449f26b0cb7486b6d0986bc681a2, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:00,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-15 19:55:00,837 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:00,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:55:00,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87e1449f26b0cb7486b6d0986bc681a2, disabling compactions & flushes 2023-11-15 19:55:00,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:55:00,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:55:00,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. after waiting 0 ms 2023-11-15 19:55:00,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:55:00,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-15 19:55:00,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-15 19:55:00,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2. 2023-11-15 19:55:00,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87e1449f26b0cb7486b6d0986bc681a2: 2023-11-15 19:55:00,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:55:00,845 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=87e1449f26b0cb7486b6d0986bc681a2, regionState=CLOSED 2023-11-15 19:55:00,845 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700078100844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078100844"}]},"ts":"1700078100844"} 2023-11-15 19:55:00,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-15 19:55:00,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 87e1449f26b0cb7486b6d0986bc681a2, server=jenkins-hbase4.apache.org,42249,1700078002491 in 160 msec 2023-11-15 19:55:00,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-15 19:55:00,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=87e1449f26b0cb7486b6d0986bc681a2, UNASSIGN in 165 msec 2023-11-15 19:55:00,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078100850"}]},"ts":"1700078100850"} 2023-11-15 19:55:00,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-15 19:55:00,853 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-15 19:55:00,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-11-15 19:55:00,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-15 19:55:00,982 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-15 19:55:00,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-15 19:55:00,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-15 19:55:00,994 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-15 19:55:00,995 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-15 19:55:00,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-15 19:55:00,998 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:55:01,000 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1, FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/recovered.edits] 2023-11-15 19:55:01,003 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/1e029a73944143d19c5c0ea3fe538424 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/1e029a73944143d19c5c0ea3fe538424 2023-11-15 19:55:01,004 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/f1/a7cbecb9ff0246ca87ad93f7fae213fd 2023-11-15 19:55:01,006 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/recovered.edits/15.seqid to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2/recovered.edits/15.seqid 2023-11-15 19:55:01,006 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testGetAfterCompaction/87e1449f26b0cb7486b6d0986bc681a2 2023-11-15 19:55:01,006 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-15 19:55:01,007 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-15 19:55:01,007 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-15 19:55:01,010 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111596f3dcb4cf61468bb973216933a8f94c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111596f3dcb4cf61468bb973216933a8f94c 2023-11-15 19:55:01,010 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-15 19:55:01,012 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-15 19:55:01,034 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-15 19:55:01,036 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-15 19:55:01,038 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-15 19:55:01,038 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-15 19:55:01,038 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700078101038"}]},"ts":"9223372036854775807"} 2023-11-15 19:55:01,039 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-15 19:55:01,039 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87e1449f26b0cb7486b6d0986bc681a2, NAME => 'testGetAfterCompaction,,1700078095238.87e1449f26b0cb7486b6d0986bc681a2.', STARTKEY => '', ENDKEY => ''}] 2023-11-15 19:55:01,040 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-15 19:55:01,040 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700078101040"}]},"ts":"9223372036854775807"} 2023-11-15 19:55:01,041 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-15 19:55:01,043 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-15 19:55:01,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 56 msec 2023-11-15 19:55:01,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-15 19:55:01,098 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-15 19:55:01,114 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238 (was 245), OpenFileDescriptor=623 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=102 (was 111), ProcessCount=169 (was 169), AvailableMemoryMB=849 (was 888) 2023-11-15 19:55:01,125 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=238, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=102, ProcessCount=169, AvailableMemoryMB=849 2023-11-15 19:55:01,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-15 19:55:01,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-15 19:55:01,129 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:55:01,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-15 19:55:01,130 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:55:01,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-15 19:55:01,132 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:01,132 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:01,132 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da empty. 2023-11-15 19:55:01,132 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:01,133 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04 empty. 2023-11-15 19:55:01,133 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:01,133 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8 empty. 2023-11-15 19:55:01,133 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:01,133 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:01,133 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-15 19:55:01,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-15 19:55:01,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-15 19:55:01,542 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-15 19:55:01,544 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 65fdc9444c3e3ebe54107538d8fc3b04, NAME => 'testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:01,544 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 622d6f4f194d5d320660fd1dcc1995da, NAME => 'testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:01,544 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 663dfc0e063cc7d4ca1e0b1843d16ec8, NAME => 'testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:01,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-15 19:55:01,955 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:01,955 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 622d6f4f194d5d320660fd1dcc1995da, disabling compactions & flushes 2023-11-15 19:55:01,955 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:01,955 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:01,955 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. after waiting 0 ms 2023-11-15 19:55:01,955 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:01,955 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:01,955 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:01,962 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:01,962 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:01,962 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 65fdc9444c3e3ebe54107538d8fc3b04, disabling compactions & flushes 2023-11-15 19:55:01,962 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 663dfc0e063cc7d4ca1e0b1843d16ec8, disabling compactions & flushes 2023-11-15 19:55:01,962 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:01,963 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. after waiting 0 ms 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. after waiting 0 ms 2023-11-15 19:55:01,963 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:01,963 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:01,963 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:01,965 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:55:01,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078101966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078101966"}]},"ts":"1700078101966"} 2023-11-15 19:55:01,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078101966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078101966"}]},"ts":"1700078101966"} 2023-11-15 19:55:01,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078101966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078101966"}]},"ts":"1700078101966"} 2023-11-15 19:55:01,968 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-15 19:55:01,969 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:55:01,969 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078101969"}]},"ts":"1700078101969"} 2023-11-15 19:55:01,970 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-15 19:55:01,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN}] 2023-11-15 19:55:01,977 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN 2023-11-15 19:55:01,977 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN 2023-11-15 19:55:01,977 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN 2023-11-15 19:55:01,978 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:01,978 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:01,978 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:02,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=663dfc0e063cc7d4ca1e0b1843d16ec8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:02,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=65fdc9444c3e3ebe54107538d8fc3b04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:02,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078102130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078102130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078102130"}]},"ts":"1700078102130"} 2023-11-15 19:55:02,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=622d6f4f194d5d320660fd1dcc1995da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:02,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078102130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078102130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078102130"}]},"ts":"1700078102130"} 2023-11-15 19:55:02,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078102130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078102130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078102130"}]},"ts":"1700078102130"} 2023-11-15 19:55:02,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 663dfc0e063cc7d4ca1e0b1843d16ec8, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:02,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 65fdc9444c3e3ebe54107538d8fc3b04, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:02,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 622d6f4f194d5d320660fd1dcc1995da, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:02,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-15 19:55:02,287 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:02,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:02,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65fdc9444c3e3ebe54107538d8fc3b04, NAME => 'testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.', STARTKEY => '1', ENDKEY => '2'} 2023-11-15 19:55:02,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:02,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,291 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,292 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:02,293 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:02,293 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65fdc9444c3e3ebe54107538d8fc3b04 columnFamilyName family1 2023-11-15 19:55:02,295 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(310): Store=65fdc9444c3e3ebe54107538d8fc3b04/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:02,295 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,296 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2 2023-11-15 19:55:02,296 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2 2023-11-15 19:55:02,297 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65fdc9444c3e3ebe54107538d8fc3b04 columnFamilyName family2 2023-11-15 19:55:02,298 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(310): Store=65fdc9444c3e3ebe54107538d8fc3b04/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:02,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:02,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:02,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:02,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 65fdc9444c3e3ebe54107538d8fc3b04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73522987, jitterRate=0.09557788074016571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:02,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:02,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04., pid=84, masterSystemTime=1700078102287 2023-11-15 19:55:02,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:02,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:02,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:02,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 622d6f4f194d5d320660fd1dcc1995da, NAME => 'testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.', STARTKEY => '', ENDKEY => '1'} 2023-11-15 19:55:02,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,308 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=65fdc9444c3e3ebe54107538d8fc3b04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:02,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:02,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,308 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078102307"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078102307"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078102307"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078102307"}]},"ts":"1700078102307"} 2023-11-15 19:55:02,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,309 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,311 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:02,311 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:02,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-11-15 19:55:02,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 65fdc9444c3e3ebe54107538d8fc3b04, server=jenkins-hbase4.apache.org,42249,1700078002491 in 177 msec 2023-11-15 19:55:02,311 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d6f4f194d5d320660fd1dcc1995da columnFamilyName family1 2023-11-15 19:55:02,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN in 336 msec 2023-11-15 19:55:02,312 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(310): Store=622d6f4f194d5d320660fd1dcc1995da/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:02,312 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,313 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2 2023-11-15 19:55:02,313 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2 2023-11-15 19:55:02,314 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d6f4f194d5d320660fd1dcc1995da columnFamilyName family2 2023-11-15 19:55:02,314 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(310): Store=622d6f4f194d5d320660fd1dcc1995da/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:02,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:02,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:02,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:02,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 622d6f4f194d5d320660fd1dcc1995da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67280450, jitterRate=0.002556830644607544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:02,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:02,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da., pid=85, masterSystemTime=1700078102287 2023-11-15 19:55:02,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:02,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:02,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:02,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 663dfc0e063cc7d4ca1e0b1843d16ec8, NAME => 'testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.', STARTKEY => '2', ENDKEY => ''} 2023-11-15 19:55:02,322 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=622d6f4f194d5d320660fd1dcc1995da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:02,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:02,322 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078102322"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078102322"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078102322"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078102322"}]},"ts":"1700078102322"} 2023-11-15 19:55:02,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,323 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,324 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:02,324 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:02,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-11-15 19:55:02,325 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 663dfc0e063cc7d4ca1e0b1843d16ec8 columnFamilyName family1 2023-11-15 19:55:02,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 622d6f4f194d5d320660fd1dcc1995da, server=jenkins-hbase4.apache.org,42249,1700078002491 in 190 msec 2023-11-15 19:55:02,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN in 350 msec 2023-11-15 19:55:02,326 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(310): Store=663dfc0e063cc7d4ca1e0b1843d16ec8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:02,326 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,327 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2 2023-11-15 19:55:02,327 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2 2023-11-15 19:55:02,327 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 663dfc0e063cc7d4ca1e0b1843d16ec8 columnFamilyName family2 2023-11-15 19:55:02,328 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(310): Store=663dfc0e063cc7d4ca1e0b1843d16ec8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:02,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:02,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:02,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:02,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 663dfc0e063cc7d4ca1e0b1843d16ec8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72246306, jitterRate=0.07655385136604309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:02,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:02,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8., pid=83, masterSystemTime=1700078102287 2023-11-15 19:55:02,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:02,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:02,335 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=663dfc0e063cc7d4ca1e0b1843d16ec8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:02,335 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078102335"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078102335"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078102335"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078102335"}]},"ts":"1700078102335"} 2023-11-15 19:55:02,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=82 2023-11-15 19:55:02,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 663dfc0e063cc7d4ca1e0b1843d16ec8, server=jenkins-hbase4.apache.org,42249,1700078002491 in 205 msec 2023-11-15 19:55:02,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=79 2023-11-15 19:55:02,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN in 362 msec 2023-11-15 19:55:02,340 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:55:02,340 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078102340"}]},"ts":"1700078102340"} 2023-11-15 19:55:02,341 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-15 19:55:02,343 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:55:02,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2160 sec 2023-11-15 19:55:03,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-15 19:55:03,235 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-15 19:55:03,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:03,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:03,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:03,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:03,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-15 19:55:03,249 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-15 19:55:03,249 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:03,249 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-15 19:55:03,249 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-15 19:55:03,250 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:03,250 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:03,251 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:03,251 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:03,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:03,252 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:03,252 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:03,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:03,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:03,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:03,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-15 19:55:03,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-15 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-15 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:03,253 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-15 19:55:03,254 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:03,254 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. started... 2023-11-15 19:55:03,254 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:03,254 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:03,254 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 622d6f4f194d5d320660fd1dcc1995da 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:03,254 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:03,254 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:03,255 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. started... 2023-11-15 19:55:03,254 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. started... 2023-11-15 19:55:03,255 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 663dfc0e063cc7d4ca1e0b1843d16ec8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:03,256 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 65fdc9444c3e3ebe54107538d8fc3b04 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:03,680 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 2023-11-15 19:55:03,689 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 2023-11-15 19:55:03,690 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 2023-11-15 19:55:03,694 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/dfe0e9e5ff9144d99c4c112f2fd49160 2023-11-15 19:55:04,084 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/3eedfd16a6f3482b91e094c39d26c83a 2023-11-15 19:55:04,095 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/ca1d9efb973447ea9e22ae97043c57b2 2023-11-15 19:55:04,108 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311157e56a504e312430f9a8dc7ce375dc907 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311157e56a504e312430f9a8dc7ce375dc907 2023-11-15 19:55:04,112 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/4dd4616568e740299cf5a320377d72f4 2023-11-15 19:55:04,115 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/dfe0e9e5ff9144d99c4c112f2fd49160 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160 2023-11-15 19:55:04,118 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160, entries=4, sequenceid=5, filesize=5.4 K 2023-11-15 19:55:04,119 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/4dd4616568e740299cf5a320377d72f4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4 2023-11-15 19:55:04,122 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:04,122 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 622d6f4f194d5d320660fd1dcc1995da in 868ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:04,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-15 19:55:04,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:04,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:04,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:04,499 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115b6985c15d12949febbfb6988a84f1049 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b6985c15d12949febbfb6988a84f1049 2023-11-15 19:55:04,507 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115376e7fe1883a449c81cd948493d84680 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115376e7fe1883a449c81cd948493d84680 2023-11-15 19:55:04,904 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/0036664ccd1142d2a132bdd8c4c8e41a 2023-11-15 19:55:04,912 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/3eedfd16a6f3482b91e094c39d26c83a as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a 2023-11-15 19:55:04,912 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/6f387b3c905d439484d967bae34514c0 2023-11-15 19:55:04,916 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a, entries=4, sequenceid=5, filesize=5.4 K 2023-11-15 19:55:04,917 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/0036664ccd1142d2a132bdd8c4c8e41a as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a 2023-11-15 19:55:04,918 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/ca1d9efb973447ea9e22ae97043c57b2 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2 2023-11-15 19:55:04,921 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:04,922 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2, entries=4, sequenceid=5, filesize=5.4 K 2023-11-15 19:55:04,922 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 65fdc9444c3e3ebe54107538d8fc3b04 in 1666ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:04,923 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:04,923 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:04,923 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:04,923 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/6f387b3c905d439484d967bae34514c0 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0 2023-11-15 19:55:04,927 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:04,927 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 663dfc0e063cc7d4ca1e0b1843d16ec8 in 1672ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:04,928 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:04,928 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-15 19:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-15 19:55:04,929 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,929 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:04,930 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,930 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-15 19:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51c8cff0[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:04,931 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-15 19:55:04,932 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,933 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,933 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-15 19:55:04,933 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-15 19:55:04,933 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:04,933 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,933 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:04,934 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,934 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-15 19:55:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:04,935 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:04,935 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-15 19:55:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:04,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:04,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:04,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-15 19:55:04,938 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-15 19:55:04,938 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:04,938 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:04,938 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-15 19:55:04,938 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:04,942 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:04,942 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:04,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:04,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:04,942 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:04,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:04,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:04,943 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:04,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:04,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:04,944 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:04,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-15 19:55:04,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:04,947 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:04,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:04,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:04,947 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:04,948 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:04,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:04,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:05,048 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:05,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:05,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:05,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:05,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:05,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:05,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:05,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-15 19:55:05,054 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-15 19:55:05,054 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:05,054 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-15 19:55:05,055 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-15 19:55:05,055 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:05,055 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:05,056 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:05,056 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:05,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:05,057 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:05,057 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:05,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:05,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:05,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:05,058 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-15 19:55:05,058 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-15 19:55:05,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-15 19:55:05,058 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-15 19:55:05,058 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:05,058 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-15 19:55:05,058 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:05,058 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:05,058 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. started... 2023-11-15 19:55:05,058 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. started... 2023-11-15 19:55:05,058 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 622d6f4f194d5d320660fd1dcc1995da 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:05,058 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 65fdc9444c3e3ebe54107538d8fc3b04 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:05,061 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:05,061 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. started... 2023-11-15 19:55:05,061 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 663dfc0e063cc7d4ca1e0b1843d16ec8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:05,074 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed 2023-11-15 19:55:05,074 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c 2023-11-15 19:55:05,089 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/a227fad1417c4ae3a61de048caa71738 2023-11-15 19:55:05,090 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/99033ab409ee47738c5f6c271e062d2d 2023-11-15 19:55:05,474 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 2023-11-15 19:55:05,518 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311159321ed13726a425dbcfbb35dc481cb17 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311159321ed13726a425dbcfbb35dc481cb17 2023-11-15 19:55:05,526 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115b343d8f8776646ba81c8ac64062a3a59 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b343d8f8776646ba81c8ac64062a3a59 2023-11-15 19:55:05,882 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/eb77a11fb1c3474d82620ba1775b9499 2023-11-15 19:55:05,923 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/430d3cae0a474f2f8868f33e72d65c98 2023-11-15 19:55:05,927 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/99033ab409ee47738c5f6c271e062d2d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d 2023-11-15 19:55:05,930 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d, entries=4, sequenceid=9, filesize=5.4 K 2023-11-15 19:55:05,930 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/430d3cae0a474f2f8868f33e72d65c98 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98 2023-11-15 19:55:05,931 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/477d6375222c4c1eb5e8b83f1f31a72e 2023-11-15 19:55:05,934 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:05,934 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/a227fad1417c4ae3a61de048caa71738 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738 2023-11-15 19:55:05,935 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 663dfc0e063cc7d4ca1e0b1843d16ec8 in 874ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:05,935 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:05,935 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:05,935 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:05,937 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738, entries=4, sequenceid=9, filesize=5.4 K 2023-11-15 19:55:05,938 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/477d6375222c4c1eb5e8b83f1f31a72e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e 2023-11-15 19:55:05,941 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:05,942 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 65fdc9444c3e3ebe54107538d8fc3b04 in 884ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:05,942 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:05,942 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:05,942 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:06,296 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111579fd4aba603e49aaa8e48780a58081e3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111579fd4aba603e49aaa8e48780a58081e3 2023-11-15 19:55:06,344 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:55:06,701 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/d2accd1fcd03476fac40c3527bef764d 2023-11-15 19:55:06,706 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/eb77a11fb1c3474d82620ba1775b9499 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499 2023-11-15 19:55:06,709 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499, entries=4, sequenceid=9, filesize=5.4 K 2023-11-15 19:55:06,710 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/d2accd1fcd03476fac40c3527bef764d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d 2023-11-15 19:55:06,713 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:06,714 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 622d6f4f194d5d320660fd1dcc1995da in 1656ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:06,714 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:06,714 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:06,714 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:06,714 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:06,714 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,715 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-15 19:55:06,715 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-15 19:55:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,722 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:06,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:06,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:06,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:06,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:06,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:06,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-15 19:55:06,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@528808f6[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:06,724 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-15 19:55:06,724 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,725 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-15 19:55:06,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-15 19:55:06,725 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:06,725 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,725 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:06,727 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-15 19:55:06,727 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:06,727 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,727 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-15 19:55:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:06,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:06,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:06,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-15 19:55:06,729 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-15 19:55:06,729 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:06,729 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:06,729 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-15 19:55:06,729 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:06,731 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,731 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:06,731 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:06,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:06,732 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:06,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:06,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,733 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,736 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,736 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:06,736 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:06,736 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:06,736 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:06,736 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-15 19:55:06,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:06,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:06,736 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:06,737 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,737 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:06,737 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,737 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:06,737 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:06,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:06,837 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:06,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:06,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:06,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:06,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:06,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-15 19:55:06,843 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-15 19:55:06,843 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:06,843 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-15 19:55:06,843 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-15 19:55:06,844 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,844 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:06,845 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:06,845 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:06,845 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:06,845 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:06,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:06,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-15 19:55:06,846 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-15 19:55:06,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-15 19:55:06,847 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-15 19:55:06,847 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:06,847 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-15 19:55:06,847 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:06,847 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:06,847 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. started... 2023-11-15 19:55:06,847 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. started... 2023-11-15 19:55:06,847 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 622d6f4f194d5d320660fd1dcc1995da 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:06,847 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 65fdc9444c3e3ebe54107538d8fc3b04 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:06,849 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:06,849 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:06,849 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:06,849 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. started... 2023-11-15 19:55:06,849 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 663dfc0e063cc7d4ca1e0b1843d16ec8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:06,878 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc 2023-11-15 19:55:06,882 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/f0ac4c965f77433181c643b74a2314a5 2023-11-15 19:55:07,276 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 2023-11-15 19:55:07,278 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a 2023-11-15 19:55:07,281 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/ac3d3fc1e17e4722bca5cd17bac407b2 2023-11-15 19:55:07,294 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115e18242ee448d41cf9007e9332853aefe to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115e18242ee448d41cf9007e9332853aefe 2023-11-15 19:55:07,683 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/c9af185d4b5a4b56b230e555e2323e14 2023-11-15 19:55:07,698 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111518916612b0934d8b84368bb8b4db0a8d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111518916612b0934d8b84368bb8b4db0a8d 2023-11-15 19:55:07,699 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/22e8336c0e1e46bab0730aff8e33aeb6 2023-11-15 19:55:07,704 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/f0ac4c965f77433181c643b74a2314a5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5 2023-11-15 19:55:07,714 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5, entries=4, sequenceid=13, filesize=5.4 K 2023-11-15 19:55:07,715 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/22e8336c0e1e46bab0730aff8e33aeb6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6 2023-11-15 19:55:07,719 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:07,720 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 663dfc0e063cc7d4ca1e0b1843d16ec8 in 871ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:07,720 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:07,720 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:07,720 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:07,723 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/380e33f7addc45d28d9b9bd53251bcd1 2023-11-15 19:55:07,735 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/ac3d3fc1e17e4722bca5cd17bac407b2 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2 2023-11-15 19:55:07,739 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2, entries=4, sequenceid=13, filesize=5.4 K 2023-11-15 19:55:07,740 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/380e33f7addc45d28d9b9bd53251bcd1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1 2023-11-15 19:55:07,743 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:07,744 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 65fdc9444c3e3ebe54107538d8fc3b04 in 897ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:07,744 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:07,744 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:08,118 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111511394cce53124a49840cfd3ef4c6a9b6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111511394cce53124a49840cfd3ef4c6a9b6 2023-11-15 19:55:08,524 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf 2023-11-15 19:55:08,529 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/c9af185d4b5a4b56b230e555e2323e14 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14 2023-11-15 19:55:08,532 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14, entries=4, sequenceid=13, filesize=5.4 K 2023-11-15 19:55:08,533 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf 2023-11-15 19:55:08,537 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:08,537 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 622d6f4f194d5d320660fd1dcc1995da in 1690ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:08,537 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:08,537 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:08,538 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:08,538 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:08,538 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,538 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-15 19:55:08,538 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-15 19:55:08,540 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,540 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:08,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:08,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-15 19:55:08,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35906480[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:08,542 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-15 19:55:08,542 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,543 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-15 19:55:08,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-15 19:55:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:08,544 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,544 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:08,545 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-15 19:55:08,545 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,545 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:08,545 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-15 19:55:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:08,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:08,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:08,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-15 19:55:08,548 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-15 19:55:08,548 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:08,548 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:08,548 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-15 19:55:08,548 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:08,549 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,549 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:08,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,549 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:08,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:08,550 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:08,551 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:08,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-15 19:55:08,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,554 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:08,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-15 19:55:08,554 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:08,654 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:08,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:08,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:08,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:08,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:08,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:08,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:08,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-15 19:55:08,660 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-15 19:55:08,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:08,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-15 19:55:08,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-15 19:55:08,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:08,662 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:08,662 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:08,662 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:08,663 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:08,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:08,663 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-15 19:55:08,663 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-15 19:55:08,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-15 19:55:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-15 19:55:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-15 19:55:08,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:08,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:08,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:08,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. started... 2023-11-15 19:55:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:08,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. started... 2023-11-15 19:55:08,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. started... 2023-11-15 19:55:08,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 65fdc9444c3e3ebe54107538d8fc3b04 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:08,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 663dfc0e063cc7d4ca1e0b1843d16ec8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:08,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 622d6f4f194d5d320660fd1dcc1995da 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:09,081 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a 2023-11-15 19:55:09,081 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 2023-11-15 19:55:09,081 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 2023-11-15 19:55:09,492 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/c58e580fe9a041bda868d5daf52ffcfd 2023-11-15 19:55:09,492 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/95433af143e1498490dcb4505637f679 2023-11-15 19:55:09,493 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/a31b252731994341ae8806e6997991b7 2023-11-15 19:55:09,511 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311158ae086b0a9874f45b0dc4aca42ed6675 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311158ae086b0a9874f45b0dc4aca42ed6675 2023-11-15 19:55:09,910 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111551a63a8cc28d4b4cb16649a61014b84f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111551a63a8cc28d4b4cb16649a61014b84f 2023-11-15 19:55:09,910 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115195179110cb7492dab9cf1e118951672 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115195179110cb7492dab9cf1e118951672 2023-11-15 19:55:09,915 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/d376d72748844c7b9f194c186d74bf6e 2023-11-15 19:55:09,918 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/a31b252731994341ae8806e6997991b7 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7 2023-11-15 19:55:09,922 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7, entries=4, sequenceid=17, filesize=5.4 K 2023-11-15 19:55:09,922 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/d376d72748844c7b9f194c186d74bf6e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e 2023-11-15 19:55:09,926 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:09,927 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 622d6f4f194d5d320660fd1dcc1995da in 1263ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:10,316 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/e882d6befa654f1395c4447af18b0b39 2023-11-15 19:55:10,316 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/704e7fcb4bf04ddabffcfde79fba0973 2023-11-15 19:55:10,323 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/95433af143e1498490dcb4505637f679 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679 2023-11-15 19:55:10,324 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/c58e580fe9a041bda868d5daf52ffcfd as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd 2023-11-15 19:55:10,333 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679, entries=4, sequenceid=17, filesize=5.4 K 2023-11-15 19:55:10,334 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/e882d6befa654f1395c4447af18b0b39 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39 2023-11-15 19:55:10,334 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd, entries=4, sequenceid=17, filesize=5.4 K 2023-11-15 19:55:10,335 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/704e7fcb4bf04ddabffcfde79fba0973 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973 2023-11-15 19:55:10,340 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:10,341 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 663dfc0e063cc7d4ca1e0b1843d16ec8 in 1677ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:10,341 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:10,341 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:10,342 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:10,343 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 65fdc9444c3e3ebe54107538d8fc3b04 in 1679ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:10,343 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:10,343 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-15 19:55:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-15 19:55:10,346 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:10,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:10,346 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,347 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,347 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:10,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:10,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:10,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:10,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:10,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-15 19:55:10,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b466a15[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:10,349 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-15 19:55:10,349 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,351 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-15 19:55:10,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-15 19:55:10,351 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:10,351 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,351 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-15 19:55:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:10,353 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,353 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-15 19:55:10,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:10,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:10,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:10,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:10,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:10,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:10,356 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-15 19:55:10,357 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:10,357 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:10,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-15 19:55:10,357 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-15 19:55:10,357 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:10,359 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:10,359 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:10,359 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:10,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:10,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:10,360 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:10,361 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,364 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,364 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:10,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-15 19:55:10,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:10,364 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:10,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-15 19:55:10,364 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:10,364 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:10,364 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,364 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:10,365 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,365 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:10,364 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:10,365 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:10,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:10,365 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:10,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:10,465 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:10,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:10,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-15 19:55:10,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700078110476 (current time:1700078110476). 2023-11-15 19:55:10,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-15 19:55:10,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] zookeeper.ReadOnlyZKClient(139): Connect 0x5d1c6d23 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:55:10,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b3b9d0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:55:10,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:55:10,490 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:55:10,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d1c6d23 to 127.0.0.1:50885 2023-11-15 19:55:10,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:55:10,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-15 19:55:10,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-15 19:55:10,500 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot, current working dir path: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/snaptb-1700078110466 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-15 19:55:10,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-15 19:55:10,507 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-15 19:55:10,508 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700078710508 2023-11-15 19:55:10,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-15 19:55:10,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700078110466 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-15 19:55:10,509 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-15 19:55:10,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-15 19:55:10,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-15 19:55:10,511 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-15 19:55:10,511 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700078710511 2023-11-15 19:55:10,513 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:10,513 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-15 19:55:10,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700078110466 2023-11-15 19:55:10,521 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700078110466' 2023-11-15 19:55:10,521 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-15 19:55:10,521 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700078110466' starting 'acquire' 2023-11-15 19:55:10,521 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700078110466', kicking off acquire phase on members. 2023-11-15 19:55:10,522 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,522 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700078110466 2023-11-15 19:55:10,523 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-15 19:55:10,523 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-15 19:55:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-15 19:55:10,523 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,523 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700078110466 2023-11-15 19:55:10,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-15 19:55:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700078110466 2023-11-15 19:55:10,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700078110466 from table testCompactionWithHFileLink type FLUSH 2023-11-15 19:55:10,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700078110466 2023-11-15 19:55:10,528 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700078110466' with timeout 300000ms 2023-11-15 19:55:10,528 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-15 19:55:10,528 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700078110466' starting 'acquire' stage 2023-11-15 19:55:10,528 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700078110466' locally acquired 2023-11-15 19:55:10,528 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (snaptb-1700078110466) in zk 2023-11-15 19:55:10,529 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,529 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-15 19:55:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700078110466' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700078110466 2023-11-15 19:55:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:10,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'snaptb-1700078110466' on coordinator 2023-11-15 19:55:10,532 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700078110466' starting 'in-barrier' execution. 2023-11-15 19:55:10,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ce68fc2[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:10,532 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,533 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,533 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700078110466' received 'reached' from coordinator. 2023-11-15 19:55:10,533 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,533 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:10,534 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:10,534 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. started... 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. started... 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. started... 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:10,534 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:10,535 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.' region-info for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,535 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.' region-info for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,535 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.' region-info for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,540 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-15 19:55:10,540 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-15 19:55:10,540 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-15 19:55:10,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679] hfiles 2023-11-15 19:55:10,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7] hfiles 2023-11-15 19:55:10,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd] hfiles 2023-11-15 19:55:10,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e] hfiles 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973] hfiles 2023-11-15 19:55:10,550 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39] hfiles 2023-11-15 19:55:10,550 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,550 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,550 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,550 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,550 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,553 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,553 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,550 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,553 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,553 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973 for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,565 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. completed. 2023-11-15 19:55:10,565 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. completed. 2023-11-15 19:55:10,565 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:10,565 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-15 19:55:10,565 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-15 19:55:10,613 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:10,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:10,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-15 19:55:10,617 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-15 19:55:10,817 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:10,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:10,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-15 19:55:10,818 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-15 19:55:10,960 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. completed. 2023-11-15 19:55:10,960 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-15 19:55:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-15 19:55:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700078110466' locally completed 2023-11-15 19:55:10,960 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700078110466' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:10,963 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,963 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700078110466' has notified controller of completion 2023-11-15 19:55:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-15 19:55:10,963 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:10,963 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700078110466' completed. 2023-11-15 19:55:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700078110466 2023-11-15 19:55:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700078110466 2023-11-15 19:55:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700078110466' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:10,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'snaptb-1700078110466', counting down latch. Waiting for 0 more 2023-11-15 19:55:10,966 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700078110466' execution completed 2023-11-15 19:55:10,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:10,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:10,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700078110466 2023-11-15 19:55:10,966 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700078110466including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-15 19:55:10,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-15 19:55:10,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,970 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-15 19:55:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-15 19:55:10,972 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-15 19:55:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700078110466 2023-11-15 19:55:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700078110466 2023-11-15 19:55:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,973 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700078110466 2023-11-15 19:55:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-15 19:55:10,976 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700078110466 2023-11-15 19:55:10,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700078110466 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700078110466 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700078110466/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700078110466 2023-11-15 19:55:10,976 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700078110466 2023-11-15 19:55:10,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700078110466 2023-11-15 19:55:10,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-15 19:55:10,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-15 19:55:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a] mob files 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc 2023-11-15 19:55:10,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 2023-11-15 19:55:10,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed 2023-11-15 19:55:10,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 2023-11-15 19:55:10,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 2023-11-15 19:55:10,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 2023-11-15 19:55:10,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111518916612b0934d8b84368bb8b4db0a8d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111551a63a8cc28d4b4cb16649a61014b84f, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b343d8f8776646ba81c8ac64062a3a59, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b6985c15d12949febbfb6988a84f1049, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115195179110cb7492dab9cf1e118951672, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115376e7fe1883a449c81cd948493d84680, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311159321ed13726a425dbcfbb35dc481cb17, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115e18242ee448d41cf9007e9332853aefe, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111511394cce53124a49840cfd3ef4c6a9b6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111579fd4aba603e49aaa8e48780a58081e3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311157e56a504e312430f9a8dc7ce375dc907, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311158ae086b0a9874f45b0dc4aca42ed6675] mob files 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111518916612b0934d8b84368bb8b4db0a8d 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111551a63a8cc28d4b4cb16649a61014b84f 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b343d8f8776646ba81c8ac64062a3a59 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b6985c15d12949febbfb6988a84f1049 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115195179110cb7492dab9cf1e118951672 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115376e7fe1883a449c81cd948493d84680 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311159321ed13726a425dbcfbb35dc481cb17 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115e18242ee448d41cf9007e9332853aefe 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111511394cce53124a49840cfd3ef4c6a9b6 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111579fd4aba603e49aaa8e48780a58081e3 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311157e56a504e312430f9a8dc7ce375dc907 2023-11-15 19:55:10,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311158ae086b0a9874f45b0dc4aca42ed6675 2023-11-15 19:55:11,118 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:11,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:11,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-15 19:55:11,119 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-15 19:55:11,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700078110466 2023-11-15 19:55:11,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/snaptb-1700078110466 2023-11-15 19:55:11,619 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:11,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:11,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-15 19:55:11,620 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-15 19:55:11,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/snaptb-1700078110466 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/snaptb-1700078110466 2023-11-15 19:55:11,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700078110466 of table testCompactionWithHFileLink completed 2023-11-15 19:55:11,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/snaptb-1700078110466 2023-11-15 19:55:11,833 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/snaptb-1700078110466 2023-11-15 19:55:11,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700078110466 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700078110508Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700078111385 (+877 ms)Consolidate snapshot: snaptb-1700078110466 at 1700078111385Loading Region manifests for snaptb-1700078110466 at 1700078111385Writing data manifest for snaptb-1700078110466 at 1700078111395 (+10 ms)Verifying snapshot: snaptb-1700078110466 at 1700078111802 (+407 ms)Snapshot snaptb-1700078110466 of table testCompactionWithHFileLink completed at 1700078111832 (+30 ms) 2023-11-15 19:55:11,834 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-15 19:55:11,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3250 sec 2023-11-15 19:55:12,620 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:12,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:12,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-15 19:55:12,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:12,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:12,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-15 19:55:12,658 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-15 19:55:12,658 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:12,658 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-15 19:55:12,658 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-15 19:55:12,659 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:12,659 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:12,660 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:12,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:12,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:12,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:12,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:12,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:12,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:12,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:12,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:12,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-15 19:55:12,662 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-15 19:55:12,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-15 19:55:12,662 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-15 19:55:12,662 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:12,662 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-15 19:55:12,662 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:12,662 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. started... 2023-11-15 19:55:12,663 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 622d6f4f194d5d320660fd1dcc1995da 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:12,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:12,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:12,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. started... 2023-11-15 19:55:12,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. started... 2023-11-15 19:55:12,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 65fdc9444c3e3ebe54107538d8fc3b04 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:12,664 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 663dfc0e063cc7d4ca1e0b1843d16ec8 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:13,088 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/3faf3226447e43ca8a794a893774c68d 2023-11-15 19:55:13,092 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3faf3226447e43ca8a794a893774c68d 2023-11-15 19:55:13,490 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/25dfd6599241426b94fc6b9208b72e0e 2023-11-15 19:55:13,490 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/6f93175020074cbb97d4b454ca2900ee 2023-11-15 19:55:13,494 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25dfd6599241426b94fc6b9208b72e0e 2023-11-15 19:55:13,494 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f93175020074cbb97d4b454ca2900ee 2023-11-15 19:55:13,910 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/00e038648f474e1d85f9827979290a22 2023-11-15 19:55:13,913 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/e77773c14a9b4cca9f49d78ba17ca258 2023-11-15 19:55:13,914 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00e038648f474e1d85f9827979290a22 2023-11-15 19:55:13,914 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/3faf3226447e43ca8a794a893774c68d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/3faf3226447e43ca8a794a893774c68d 2023-11-15 19:55:13,916 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e77773c14a9b4cca9f49d78ba17ca258 2023-11-15 19:55:13,916 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/6f93175020074cbb97d4b454ca2900ee as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6f93175020074cbb97d4b454ca2900ee 2023-11-15 19:55:13,918 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3faf3226447e43ca8a794a893774c68d 2023-11-15 19:55:13,918 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/3faf3226447e43ca8a794a893774c68d, entries=3, sequenceid=24, filesize=5.0 K 2023-11-15 19:55:13,919 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/00e038648f474e1d85f9827979290a22 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/00e038648f474e1d85f9827979290a22 2023-11-15 19:55:13,920 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f93175020074cbb97d4b454ca2900ee 2023-11-15 19:55:13,920 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6f93175020074cbb97d4b454ca2900ee, entries=3, sequenceid=24, filesize=5.0 K 2023-11-15 19:55:13,921 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/e77773c14a9b4cca9f49d78ba17ca258 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/e77773c14a9b4cca9f49d78ba17ca258 2023-11-15 19:55:13,922 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00e038648f474e1d85f9827979290a22 2023-11-15 19:55:13,923 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/00e038648f474e1d85f9827979290a22, entries=1, sequenceid=24, filesize=5.0 K 2023-11-15 19:55:13,923 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 622d6f4f194d5d320660fd1dcc1995da in 1261ms, sequenceid=24, compaction requested=true 2023-11-15 19:55:13,923 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:13,923 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:13,923 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:13,924 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e77773c14a9b4cca9f49d78ba17ca258 2023-11-15 19:55:13,924 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/e77773c14a9b4cca9f49d78ba17ca258, entries=1, sequenceid=24, filesize=5.0 K 2023-11-15 19:55:13,925 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 65fdc9444c3e3ebe54107538d8fc3b04 in 1261ms, sequenceid=24, compaction requested=true 2023-11-15 19:55:13,925 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:13,925 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:13,925 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:14,313 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/b9d6f962fb794a79892974c141537079 2023-11-15 19:55:14,318 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9d6f962fb794a79892974c141537079 2023-11-15 19:55:14,319 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/25dfd6599241426b94fc6b9208b72e0e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/25dfd6599241426b94fc6b9208b72e0e 2023-11-15 19:55:14,323 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25dfd6599241426b94fc6b9208b72e0e 2023-11-15 19:55:14,323 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/25dfd6599241426b94fc6b9208b72e0e, entries=3, sequenceid=24, filesize=5.0 K 2023-11-15 19:55:14,324 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/b9d6f962fb794a79892974c141537079 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/b9d6f962fb794a79892974c141537079 2023-11-15 19:55:14,329 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9d6f962fb794a79892974c141537079 2023-11-15 19:55:14,329 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/b9d6f962fb794a79892974c141537079, entries=1, sequenceid=24, filesize=5.0 K 2023-11-15 19:55:14,330 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 663dfc0e063cc7d4ca1e0b1843d16ec8 in 1666ms, sequenceid=24, compaction requested=true 2023-11-15 19:55:14,330 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:14,330 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-15 19:55:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-15 19:55:14,332 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,332 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:14,332 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,332 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:14,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-15 19:55:14,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e3be710[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:14,334 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-15 19:55:14,334 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,335 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-15 19:55:14,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-15 19:55:14,335 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:14,335 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,335 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:14,338 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,338 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-15 19:55:14,338 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:14,338 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-15 19:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:14,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:14,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:14,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-15 19:55:14,341 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-15 19:55:14,341 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:14,341 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:14,341 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-15 19:55:14,341 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:14,343 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:14,343 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:14,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:14,343 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:14,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:14,344 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:14,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:14,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:14,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:14,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:14,345 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:14,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-15 19:55:14,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-15 19:55:14,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-15 19:55:14,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-15 19:55:14,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-15 19:55:14,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:14,348 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-15 19:55:14,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:14,348 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:14,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:14,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:14,448 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:14,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:14,450 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:14,450 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 622d6f4f194d5d320660fd1dcc1995da/family1 is initiating major compaction (all files) 2023-11-15 19:55:14,450 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:14,450 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:14,450 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 622d6f4f194d5d320660fd1dcc1995da/family1 in testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:14,450 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/3faf3226447e43ca8a794a893774c68d] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp, totalSize=26.7 K 2023-11-15 19:55:14,451 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting dfe0e9e5ff9144d99c4c112f2fd49160, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103242 2023-11-15 19:55:14,451 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting eb77a11fb1c3474d82620ba1775b9499, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105049 2023-11-15 19:55:14,451 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting c9af185d4b5a4b56b230e555e2323e14, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:14,452 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting a31b252731994341ae8806e6997991b7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:14,452 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 3faf3226447e43ca8a794a893774c68d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-15 19:55:14,464 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 622d6f4f194d5d320660fd1dcc1995da#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:14,872 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231115bdb086c21f2846539af4e165bee4e2f6_del 2023-11-15 19:55:14,873 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115bdb086c21f2846539af4e165bee4e2f6_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115bdb086c21f2846539af4e165bee4e2f6_del 2023-11-15 19:55:15,686 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 212e05726fb44a76b59db870d7229c97 2023-11-15 19:55:15,687 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/212e05726fb44a76b59db870d7229c97 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/212e05726fb44a76b59db870d7229c97 2023-11-15 19:55:15,690 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 212e05726fb44a76b59db870d7229c97 2023-11-15 19:55:15,691 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 622d6f4f194d5d320660fd1dcc1995da/family1 of 622d6f4f194d5d320660fd1dcc1995da into 212e05726fb44a76b59db870d7229c97(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:15,691 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:15,691 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:15,691 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 622d6f4f194d5d320660fd1dcc1995da/family2 is initiating major compaction (all files) 2023-11-15 19:55:15,691 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:15,691 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:15,692 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 622d6f4f194d5d320660fd1dcc1995da/family2 in testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:15,692 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/00e038648f474e1d85f9827979290a22] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp, totalSize=25.4 K 2023-11-15 19:55:15,693 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 4dd4616568e740299cf5a320377d72f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103242 2023-11-15 19:55:15,693 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting d2accd1fcd03476fac40c3527bef764d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105049 2023-11-15 19:55:15,694 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 5af6f3ff8c1f4e569fe84898b3cf9ecf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:15,694 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting d376d72748844c7b9f194c186d74bf6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:15,694 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 00e038648f474e1d85f9827979290a22, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-15 19:55:15,704 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 622d6f4f194d5d320660fd1dcc1995da#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:15,711 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311150e1a7ef868294ccdaa8a27a0922b3783_del 2023-11-15 19:55:15,711 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311150e1a7ef868294ccdaa8a27a0922b3783_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311150e1a7ef868294ccdaa8a27a0922b3783_del 2023-11-15 19:55:15,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/3faf3226447e43ca8a794a893774c68d] to archive 2023-11-15 19:55:15,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:15,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/dfe0e9e5ff9144d99c4c112f2fd49160 2023-11-15 19:55:15,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/eb77a11fb1c3474d82620ba1775b9499 2023-11-15 19:55:15,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/c9af185d4b5a4b56b230e555e2323e14 2023-11-15 19:55:15,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/a31b252731994341ae8806e6997991b7 2023-11-15 19:55:15,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/3faf3226447e43ca8a794a893774c68d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/3faf3226447e43ca8a794a893774c68d 2023-11-15 19:55:15,727 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be2d9c144a78447e8c9be5133b16f5d4 2023-11-15 19:55:15,728 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/be2d9c144a78447e8c9be5133b16f5d4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/be2d9c144a78447e8c9be5133b16f5d4 2023-11-15 19:55:15,733 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be2d9c144a78447e8c9be5133b16f5d4 2023-11-15 19:55:15,734 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 622d6f4f194d5d320660fd1dcc1995da/family2 of 622d6f4f194d5d320660fd1dcc1995da into be2d9c144a78447e8c9be5133b16f5d4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:55:15,734 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:15,734 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:15,734 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 65fdc9444c3e3ebe54107538d8fc3b04/family1 is initiating major compaction (all files) 2023-11-15 19:55:15,735 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:15,735 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:15,735 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 65fdc9444c3e3ebe54107538d8fc3b04/family1 in testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:15,735 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6f93175020074cbb97d4b454ca2900ee] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp, totalSize=26.7 K 2023-11-15 19:55:15,735 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 3eedfd16a6f3482b91e094c39d26c83a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103244 2023-11-15 19:55:15,735 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting a227fad1417c4ae3a61de048caa71738, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:15,736 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting ac3d3fc1e17e4722bca5cd17bac407b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:15,736 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting c58e580fe9a041bda868d5daf52ffcfd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:15,736 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 6f93175020074cbb97d4b454ca2900ee, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-15 19:55:15,749 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 65fdc9444c3e3ebe54107538d8fc3b04#family1#compaction#109 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:15,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/00e038648f474e1d85f9827979290a22] to archive 2023-11-15 19:55:15,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:15,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/4dd4616568e740299cf5a320377d72f4 2023-11-15 19:55:15,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d2accd1fcd03476fac40c3527bef764d 2023-11-15 19:55:15,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/5af6f3ff8c1f4e569fe84898b3cf9ecf 2023-11-15 19:55:15,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/d376d72748844c7b9f194c186d74bf6e 2023-11-15 19:55:15,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/00e038648f474e1d85f9827979290a22 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/00e038648f474e1d85f9827979290a22 2023-11-15 19:55:16,157 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231115454dead64cc844319afcd5759eb67014_del 2023-11-15 19:55:16,158 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115454dead64cc844319afcd5759eb67014_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115454dead64cc844319afcd5759eb67014_del 2023-11-15 19:55:16,971 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6380634819114f198071948df3b4034f 2023-11-15 19:55:16,972 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/6380634819114f198071948df3b4034f as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6380634819114f198071948df3b4034f 2023-11-15 19:55:16,976 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6380634819114f198071948df3b4034f 2023-11-15 19:55:16,977 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 65fdc9444c3e3ebe54107538d8fc3b04/family1 of 65fdc9444c3e3ebe54107538d8fc3b04 into 6380634819114f198071948df3b4034f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:16,977 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:16,977 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:16,977 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 65fdc9444c3e3ebe54107538d8fc3b04/family2 is initiating major compaction (all files) 2023-11-15 19:55:16,977 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:16,977 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:16,978 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 65fdc9444c3e3ebe54107538d8fc3b04/family2 in testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:16,978 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/e77773c14a9b4cca9f49d78ba17ca258] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp, totalSize=25.4 K 2023-11-15 19:55:16,978 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 0036664ccd1142d2a132bdd8c4c8e41a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103244 2023-11-15 19:55:16,978 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 477d6375222c4c1eb5e8b83f1f31a72e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:16,979 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 380e33f7addc45d28d9b9bd53251bcd1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:16,979 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 704e7fcb4bf04ddabffcfde79fba0973, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:16,979 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting e77773c14a9b4cca9f49d78ba17ca258, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-15 19:55:16,990 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 65fdc9444c3e3ebe54107538d8fc3b04#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:17,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6f93175020074cbb97d4b454ca2900ee] to archive 2023-11-15 19:55:17,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:17,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/3eedfd16a6f3482b91e094c39d26c83a 2023-11-15 19:55:17,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/a227fad1417c4ae3a61de048caa71738 2023-11-15 19:55:17,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/ac3d3fc1e17e4722bca5cd17bac407b2 2023-11-15 19:55:17,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/c58e580fe9a041bda868d5daf52ffcfd 2023-11-15 19:55:17,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6f93175020074cbb97d4b454ca2900ee to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6f93175020074cbb97d4b454ca2900ee 2023-11-15 19:55:17,401 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231115cd0c84215ae94b019117d13a423eceba_del 2023-11-15 19:55:17,401 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115cd0c84215ae94b019117d13a423eceba_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115cd0c84215ae94b019117d13a423eceba_del 2023-11-15 19:55:18,216 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df2cfae58ff344929e65b31a45d71419 2023-11-15 19:55:18,217 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/df2cfae58ff344929e65b31a45d71419 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/df2cfae58ff344929e65b31a45d71419 2023-11-15 19:55:18,222 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df2cfae58ff344929e65b31a45d71419 2023-11-15 19:55:18,223 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 65fdc9444c3e3ebe54107538d8fc3b04/family2 of 65fdc9444c3e3ebe54107538d8fc3b04 into df2cfae58ff344929e65b31a45d71419(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:18,223 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:18,223 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:18,223 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 is initiating major compaction (all files) 2023-11-15 19:55:18,223 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:18,224 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:18,224 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 in testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:18,225 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/25dfd6599241426b94fc6b9208b72e0e] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp, totalSize=26.7 K 2023-11-15 19:55:18,225 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting ca1d9efb973447ea9e22ae97043c57b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103245 2023-11-15 19:55:18,225 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 99033ab409ee47738c5f6c271e062d2d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:18,226 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting f0ac4c965f77433181c643b74a2314a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:18,226 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 95433af143e1498490dcb4505637f679, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108657 2023-11-15 19:55:18,226 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 25dfd6599241426b94fc6b9208b72e0e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-15 19:55:18,238 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 663dfc0e063cc7d4ca1e0b1843d16ec8#family1#compaction#111 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:18,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/e77773c14a9b4cca9f49d78ba17ca258] to archive 2023-11-15 19:55:18,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:18,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/0036664ccd1142d2a132bdd8c4c8e41a 2023-11-15 19:55:18,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/477d6375222c4c1eb5e8b83f1f31a72e 2023-11-15 19:55:18,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/380e33f7addc45d28d9b9bd53251bcd1 2023-11-15 19:55:18,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/704e7fcb4bf04ddabffcfde79fba0973 2023-11-15 19:55:18,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/e77773c14a9b4cca9f49d78ba17ca258 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/e77773c14a9b4cca9f49d78ba17ca258 2023-11-15 19:55:18,651 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231115b74fe9d8d26f46eba5bf5a0620722f63_del 2023-11-15 19:55:18,651 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115b74fe9d8d26f46eba5bf5a0620722f63_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115b74fe9d8d26f46eba5bf5a0620722f63_del 2023-11-15 19:55:19,469 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e735869ef17a40cf8bb315e8c0ad2ec5 2023-11-15 19:55:19,470 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/e735869ef17a40cf8bb315e8c0ad2ec5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/e735869ef17a40cf8bb315e8c0ad2ec5 2023-11-15 19:55:19,475 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e735869ef17a40cf8bb315e8c0ad2ec5 2023-11-15 19:55:19,476 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 of 663dfc0e063cc7d4ca1e0b1843d16ec8 into e735869ef17a40cf8bb315e8c0ad2ec5(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:19,477 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:19,477 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:19,477 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 663dfc0e063cc7d4ca1e0b1843d16ec8/family2 is initiating major compaction (all files) 2023-11-15 19:55:19,477 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:19,477 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:19,477 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 663dfc0e063cc7d4ca1e0b1843d16ec8/family2 in testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:19,477 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/b9d6f962fb794a79892974c141537079] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp, totalSize=25.4 K 2023-11-15 19:55:19,478 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 6f387b3c905d439484d967bae34514c0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103245 2023-11-15 19:55:19,478 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 430d3cae0a474f2f8868f33e72d65c98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:19,479 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 22e8336c0e1e46bab0730aff8e33aeb6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:19,479 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting e882d6befa654f1395c4447af18b0b39, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108657 2023-11-15 19:55:19,480 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting b9d6f962fb794a79892974c141537079, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-15 19:55:19,501 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 663dfc0e063cc7d4ca1e0b1843d16ec8#family2#compaction#112 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:19,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/25dfd6599241426b94fc6b9208b72e0e] to archive 2023-11-15 19:55:19,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:19,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/ca1d9efb973447ea9e22ae97043c57b2 2023-11-15 19:55:19,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/99033ab409ee47738c5f6c271e062d2d 2023-11-15 19:55:19,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/f0ac4c965f77433181c643b74a2314a5 2023-11-15 19:55:19,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/95433af143e1498490dcb4505637f679 2023-11-15 19:55:19,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/25dfd6599241426b94fc6b9208b72e0e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/25dfd6599241426b94fc6b9208b72e0e 2023-11-15 19:55:19,916 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311152b22f703cff740298571cf823fa0494e_del 2023-11-15 19:55:19,916 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311152b22f703cff740298571cf823fa0494e_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311152b22f703cff740298571cf823fa0494e_del 2023-11-15 19:55:20,733 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c72c04a9be2b4585a9ad28fe1a606575 2023-11-15 19:55:20,734 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/c72c04a9be2b4585a9ad28fe1a606575 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/c72c04a9be2b4585a9ad28fe1a606575 2023-11-15 19:55:20,738 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c72c04a9be2b4585a9ad28fe1a606575 2023-11-15 19:55:20,739 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 663dfc0e063cc7d4ca1e0b1843d16ec8/family2 of 663dfc0e063cc7d4ca1e0b1843d16ec8 into c72c04a9be2b4585a9ad28fe1a606575(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:20,739 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:20,745 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:20,748 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:20,754 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:20,755 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:20,762 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-15 19:55:20,799 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-15 19:55:20,802 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231115bdb086c21f2846539af4e165bee4e2f6_del 2023-11-15 19:55:20,805 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231115454dead64cc844319afcd5759eb67014_del 2023-11-15 19:55:20,808 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231115b74fe9d8d26f46eba5bf5a0620722f63_del 2023-11-15 19:55:20,808 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:20,809 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(139): Connect 0x21d1d175 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:55:20,814 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3be53917, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:55:20,814 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:20,815 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:20,815 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:20,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/b9d6f962fb794a79892974c141537079] to archive 2023-11-15 19:55:20,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:20,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/6f387b3c905d439484d967bae34514c0 2023-11-15 19:55:20,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/430d3cae0a474f2f8868f33e72d65c98 2023-11-15 19:55:20,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/22e8336c0e1e46bab0730aff8e33aeb6 2023-11-15 19:55:20,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/e882d6befa654f1395c4447af18b0b39 2023-11-15 19:55:20,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/b9d6f962fb794a79892974c141537079 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/b9d6f962fb794a79892974c141537079 2023-11-15 19:55:20,913 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311159d1735222450497fb9a9d940c3f79bb3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311159d1735222450497fb9a9d940c3f79bb3 2023-11-15 19:55:20,915 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:20,930 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:55:20,938 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:55:20,944 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:55:20,946 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:55:20,955 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/4474f4d5f33a4d1f8daaa813ddd608c3 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-15 19:55:20,956 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/4474f4d5f33a4d1f8daaa813ddd608c3}] 2023-11-15 19:55:20,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/4474f4d5f33a4d1f8daaa813ddd608c3 for inclusion in 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:20,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-15 19:55:20,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-15 19:55:20,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:20,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/4474f4d5f33a4d1f8daaa813ddd608c3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__rbrtf92f7k3m34s1mbuvrig6rr8n6gta8lkj9k6hok2kootqcrh8k9dr2hlv6cu3/family1/4474f4d5f33a4d1f8daaa813ddd608c3 2023-11-15 19:55:20,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__rbrtf92f7k3m34s1mbuvrig6rr8n6gta8lkj9k6hok2kootqcrh8k9dr2hlv6cu3/family1/4474f4d5f33a4d1f8daaa813ddd608c3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_ 2023-11-15 19:55:20,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__rbrtf92f7k3m34s1mbuvrig6rr8n6gta8lkj9k6hok2kootqcrh8k9dr2hlv6cu3/family1/4474f4d5f33a4d1f8daaa813ddd608c3 into 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_ - updating store file list. 2023-11-15 19:55:20,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_ into 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:20,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__rbrtf92f7k3m34s1mbuvrig6rr8n6gta8lkj9k6hok2kootqcrh8k9dr2hlv6cu3/family1/4474f4d5f33a4d1f8daaa813ddd608c3 into 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_) 2023-11-15 19:55:20,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__rbrtf92f7k3m34s1mbuvrig6rr8n6gta8lkj9k6hok2kootqcrh8k9dr2hlv6cu3/family1/4474f4d5f33a4d1f8daaa813ddd608c3 2023-11-15 19:55:20,972 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:20,972 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:20,973 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 2023-11-15 19:55:20,974 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc 2023-11-15 19:55:20,975 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 2023-11-15 19:55:20,976 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed 2023-11-15 19:55:20,976 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-15 19:55:20,976 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115' 2023-11-15 19:55:20,976 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:21,740 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115ba7aefb65b2e4e4695982e821e82e27e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115ba7aefb65b2e4e4695982e821e82e27e 2023-11-15 19:55:21,741 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:21,742 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115a1cf4d7c1e694b2f9c7fd99b157c2eb7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115a1cf4d7c1e694b2f9c7fd99b157c2eb7 2023-11-15 19:55:21,742 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:21,770 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/7e8fd8a65221447d8e842631137a8fe2 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-15 19:55:21,770 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/44976f404fce4e77b43fdcfb4257e11c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-15 19:55:21,772 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/7e8fd8a65221447d8e842631137a8fe2}] 2023-11-15 19:55:21,772 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/44976f404fce4e77b43fdcfb4257e11c}] 2023-11-15 19:55:21,774 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/7e8fd8a65221447d8e842631137a8fe2 for inclusion in 65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:21,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/44976f404fce4e77b43fdcfb4257e11c for inclusion in 622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:21,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-15 19:55:21,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-15 19:55:21,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-15 19:55:21,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last=1 2023-11-15 19:55:21,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:21,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:21,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/7e8fd8a65221447d8e842631137a8fe2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__s93a5lssm0l290vs6s102pjretjmeh4d1u09glu11uqq2ikcsfetf7tfpna9h0vk/family1/7e8fd8a65221447d8e842631137a8fe2 2023-11-15 19:55:21,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/44976f404fce4e77b43fdcfb4257e11c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__nj8fljbtkfmm9q5e7d8ot6ukqf93q2otb3t0bgu8k0dcr8i850ucft84c3vdtl72/family1/44976f404fce4e77b43fdcfb4257e11c 2023-11-15 19:55:21,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__s93a5lssm0l290vs6s102pjretjmeh4d1u09glu11uqq2ikcsfetf7tfpna9h0vk/family1/7e8fd8a65221447d8e842631137a8fe2 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_ 2023-11-15 19:55:21,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__nj8fljbtkfmm9q5e7d8ot6ukqf93q2otb3t0bgu8k0dcr8i850ucft84c3vdtl72/family1/44976f404fce4e77b43fdcfb4257e11c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_ 2023-11-15 19:55:21,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__s93a5lssm0l290vs6s102pjretjmeh4d1u09glu11uqq2ikcsfetf7tfpna9h0vk/family1/7e8fd8a65221447d8e842631137a8fe2 into 65fdc9444c3e3ebe54107538d8fc3b04/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_ - updating store file list. 2023-11-15 19:55:21,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__nj8fljbtkfmm9q5e7d8ot6ukqf93q2otb3t0bgu8k0dcr8i850ucft84c3vdtl72/family1/44976f404fce4e77b43fdcfb4257e11c into 622d6f4f194d5d320660fd1dcc1995da/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_ - updating store file list. 2023-11-15 19:55:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_ into 65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__s93a5lssm0l290vs6s102pjretjmeh4d1u09glu11uqq2ikcsfetf7tfpna9h0vk/family1/7e8fd8a65221447d8e842631137a8fe2 into 65fdc9444c3e3ebe54107538d8fc3b04/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_) 2023-11-15 19:55:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_ into 622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__nj8fljbtkfmm9q5e7d8ot6ukqf93q2otb3t0bgu8k0dcr8i850ucft84c3vdtl72/family1/44976f404fce4e77b43fdcfb4257e11c into 622d6f4f194d5d320660fd1dcc1995da/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_) 2023-11-15 19:55:21,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__s93a5lssm0l290vs6s102pjretjmeh4d1u09glu11uqq2ikcsfetf7tfpna9h0vk/family1/7e8fd8a65221447d8e842631137a8fe2 2023-11-15 19:55:21,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__nj8fljbtkfmm9q5e7d8ot6ukqf93q2otb3t0bgu8k0dcr8i850ucft84c3vdtl72/family1/44976f404fce4e77b43fdcfb4257e11c 2023-11-15 19:55:21,788 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:21,788 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:21,789 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:21,789 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:21,791 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 2023-11-15 19:55:21,791 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 2023-11-15 19:55:21,792 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 2023-11-15 19:55:21,792 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c 2023-11-15 19:55:21,794 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 2023-11-15 19:55:21,794 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 2023-11-15 19:55:21,795 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a 2023-11-15 19:55:21,795 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-15 19:55:21,795 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115' 2023-11-15 19:55:21,796 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:21,796 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a 2023-11-15 19:55:21,796 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-15 19:55:21,796 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115' 2023-11-15 19:55:21,796 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:21,796 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:21,797 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:21,797 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115bdb086c21f2846539af4e165bee4e2f6_del] 2023-11-15 19:55:21,797 DEBUG [Listener at localhost/43577] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:21,799 DEBUG [Listener at localhost/43577] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115bdb086c21f2846539af4e165bee4e2f6_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115bdb086c21f2846539af4e165bee4e2f6_del 2023-11-15 19:55:21,799 INFO [Listener at localhost/43577] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-15 19:55:21,799 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115454dead64cc844319afcd5759eb67014_del] 2023-11-15 19:55:21,799 DEBUG [Listener at localhost/43577] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:21,801 DEBUG [Listener at localhost/43577] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115454dead64cc844319afcd5759eb67014_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115454dead64cc844319afcd5759eb67014_del 2023-11-15 19:55:21,801 INFO [Listener at localhost/43577] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-15 19:55:21,801 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115b74fe9d8d26f46eba5bf5a0620722f63_del] 2023-11-15 19:55:21,802 DEBUG [Listener at localhost/43577] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:21,803 DEBUG [Listener at localhost/43577] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115b74fe9d8d26f46eba5bf5a0620722f63_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115b74fe9d8d26f46eba5bf5a0620722f63_del 2023-11-15 19:55:21,803 INFO [Listener at localhost/43577] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-15 19:55:21,807 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:21,809 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:21,812 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:21,813 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:21,818 INFO [Listener at localhost/43577] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-15 19:55:21,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-15 19:55:21,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-15 19:55:21,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-15 19:55:21,822 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078121822"}]},"ts":"1700078121822"} 2023-11-15 19:55:21,823 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-15 19:55:21,825 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-15 19:55:21,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, UNASSIGN}] 2023-11-15 19:55:21,827 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, UNASSIGN 2023-11-15 19:55:21,828 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, UNASSIGN 2023-11-15 19:55:21,829 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, UNASSIGN 2023-11-15 19:55:21,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=663dfc0e063cc7d4ca1e0b1843d16ec8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:21,829 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078121829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078121829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078121829"}]},"ts":"1700078121829"} 2023-11-15 19:55:21,830 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=65fdc9444c3e3ebe54107538d8fc3b04, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:21,830 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=622d6f4f194d5d320660fd1dcc1995da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:21,830 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078121830"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078121830"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078121830"}]},"ts":"1700078121830"} 2023-11-15 19:55:21,830 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078121830"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078121830"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078121830"}]},"ts":"1700078121830"} 2023-11-15 19:55:21,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 663dfc0e063cc7d4ca1e0b1843d16ec8, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:21,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 65fdc9444c3e3ebe54107538d8fc3b04, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:21,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 622d6f4f194d5d320660fd1dcc1995da, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-15 19:55:21,983 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:21,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:21,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 622d6f4f194d5d320660fd1dcc1995da, disabling compactions & flushes 2023-11-15 19:55:21,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:21,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:21,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. after waiting 0 ms 2023-11-15 19:55:21,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:21,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-15 19:55:21,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:21,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:21,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:21,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:21,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 663dfc0e063cc7d4ca1e0b1843d16ec8, disabling compactions & flushes 2023-11-15 19:55:21,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:21,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:21,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. after waiting 0 ms 2023-11-15 19:55:21,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:21,993 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=622d6f4f194d5d320660fd1dcc1995da, regionState=CLOSED 2023-11-15 19:55:21,993 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078121993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078121993"}]},"ts":"1700078121993"} 2023-11-15 19:55:21,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=89 2023-11-15 19:55:21,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 622d6f4f194d5d320660fd1dcc1995da, server=jenkins-hbase4.apache.org,42249,1700078002491 in 162 msec 2023-11-15 19:55:21,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, UNASSIGN in 170 msec 2023-11-15 19:55:21,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-15 19:55:21,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:22,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:22,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:22,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:22,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 65fdc9444c3e3ebe54107538d8fc3b04, disabling compactions & flushes 2023-11-15 19:55:22,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:22,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:22,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. after waiting 0 ms 2023-11-15 19:55:22,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:22,001 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=663dfc0e063cc7d4ca1e0b1843d16ec8, regionState=CLOSED 2023-11-15 19:55:22,001 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078122001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078122001"}]},"ts":"1700078122001"} 2023-11-15 19:55:22,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=91 2023-11-15 19:55:22,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 663dfc0e063cc7d4ca1e0b1843d16ec8, server=jenkins-hbase4.apache.org,42249,1700078002491 in 172 msec 2023-11-15 19:55:22,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, UNASSIGN in 179 msec 2023-11-15 19:55:22,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-15 19:55:22,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:22,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:22,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:22,009 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=65fdc9444c3e3ebe54107538d8fc3b04, regionState=CLOSED 2023-11-15 19:55:22,009 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078122009"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078122009"}]},"ts":"1700078122009"} 2023-11-15 19:55:22,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=90 2023-11-15 19:55:22,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 65fdc9444c3e3ebe54107538d8fc3b04, server=jenkins-hbase4.apache.org,42249,1700078002491 in 178 msec 2023-11-15 19:55:22,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=90, resume processing ppid=88 2023-11-15 19:55:22,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, UNASSIGN in 186 msec 2023-11-15 19:55:22,014 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078122013"}]},"ts":"1700078122013"} 2023-11-15 19:55:22,015 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-15 19:55:22,017 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-15 19:55:22,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 199 msec 2023-11-15 19:55:22,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-15 19:55:22,124 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-15 19:55:22,137 INFO [Listener at localhost/43577] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:22,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-15 19:55:22,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700078122138 (current time:1700078122138). 2023-11-15 19:55:22,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-15 19:55:22,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] zookeeper.ReadOnlyZKClient(139): Connect 0x7ad35abe to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:55:22,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b7df91b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:55:22,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:55:22,147 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:55:22,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ad35abe to 127.0.0.1:50885 2023-11-15 19:55:22,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:55:22,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-15 19:55:22,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-15 19:55:22,150 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot, current working dir path: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700078110466-1700078122137 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-15 19:55:22,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-15 19:55:22,153 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-15 19:55:22,153 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700078722153 2023-11-15 19:55:22,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700078110466-1700078122137 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-15 19:55:22,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-15 19:55:22,154 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:22,154 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-15 19:55:22,254 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:22,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:22,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-15 19:55:22,255 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-15 19:55:22,455 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:22,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:22,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-15 19:55:22,456 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-15 19:55:22,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-15 19:55:22,561 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6380634819114f198071948df3b4034f] hfiles 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_ 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6380634819114f198071948df3b4034f 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/212e05726fb44a76b59db870d7229c97, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_] hfiles 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/212e05726fb44a76b59db870d7229c97 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_ 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/e735869ef17a40cf8bb315e8c0ad2ec5] hfiles 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_ 2023-11-15 19:55:22,564 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/e735869ef17a40cf8bb315e8c0ad2ec5 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115a1cf4d7c1e694b2f9c7fd99b157c2eb7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311159d1735222450497fb9a9d940c3f79bb3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115ba7aefb65b2e4e4695982e821e82e27e] hfiles 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115a1cf4d7c1e694b2f9c7fd99b157c2eb7 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311159d1735222450497fb9a9d940c3f79bb3 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115ba7aefb65b2e4e4695982e821e82e27e 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/df2cfae58ff344929e65b31a45d71419] hfiles 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/be2d9c144a78447e8c9be5133b16f5d4] hfiles 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/df2cfae58ff344929e65b31a45d71419 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/be2d9c144a78447e8c9be5133b16f5d4 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/c72c04a9be2b4585a9ad28fe1a606575] hfiles 2023-11-15 19:55:22,565 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/c72c04a9be2b4585a9ad28fe1a606575 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111518916612b0934d8b84368bb8b4db0a8d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111551a63a8cc28d4b4cb16649a61014b84f, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b343d8f8776646ba81c8ac64062a3a59, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b6985c15d12949febbfb6988a84f1049, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115cd0c84215ae94b019117d13a423eceba_del, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115195179110cb7492dab9cf1e118951672, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311152b22f703cff740298571cf823fa0494e_del, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115376e7fe1883a449c81cd948493d84680, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311159321ed13726a425dbcfbb35dc481cb17, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115e18242ee448d41cf9007e9332853aefe, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311150e1a7ef868294ccdaa8a27a0922b3783_del, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111511394cce53124a49840cfd3ef4c6a9b6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111579fd4aba603e49aaa8e48780a58081e3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311157e56a504e312430f9a8dc7ce375dc907, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311158ae086b0a9874f45b0dc4aca42ed6675] hfiles 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111518916612b0934d8b84368bb8b4db0a8d 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111551a63a8cc28d4b4cb16649a61014b84f 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b343d8f8776646ba81c8ac64062a3a59 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115b6985c15d12949febbfb6988a84f1049 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115cd0c84215ae94b019117d13a423eceba_del 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115195179110cb7492dab9cf1e118951672 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311152b22f703cff740298571cf823fa0494e_del 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115376e7fe1883a449c81cd948493d84680 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311159321ed13726a425dbcfbb35dc481cb17 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231115e18242ee448d41cf9007e9332853aefe 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311150e1a7ef868294ccdaa8a27a0922b3783_del 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111511394cce53124a49840cfd3ef4c6a9b6 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111579fd4aba603e49aaa8e48780a58081e3 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311157e56a504e312430f9a8dc7ce375dc907 2023-11-15 19:55:22,573 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311158ae086b0a9874f45b0dc4aca42ed6675 2023-11-15 19:55:22,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-15 19:55:22,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:22,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:22,756 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:22,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:22,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-15 19:55:22,757 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-15 19:55:23,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700078110466-1700078122137 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:23,023 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700078110466-1700078122137 of table testCompactionWithHFileLink completed 2023-11-15 19:55:23,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:23,023 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:23,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700078110466-1700078122137 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700078122153Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700078122559 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700078110466-1700078122137 at 1700078122584 (+25 ms)Loading Region manifests for hbase-failsafe-snaptb-1700078110466-1700078122137 at 1700078122584Writing data manifest for hbase-failsafe-snaptb-1700078110466-1700078122137 at 1700078122589 (+5 ms)Verifying snapshot: hbase-failsafe-snaptb-1700078110466-1700078122137 at 1700078123006 (+417 ms)Snapshot hbase-failsafe-snaptb-1700078110466-1700078122137 of table testCompactionWithHFileLink completed at 1700078123023 (+17 ms) 2023-11-15 19:55:23,024 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-15 19:55:23,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 872 msec 2023-11-15 19:55:23,257 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-15 19:55:23,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-15 19:55:23,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700078110466-1700078122137 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-15 19:55:23,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700078110466" table: "testCompactionWithHFileLink" creation_time: 1700078110476 type: FLUSH version: 2 ttl: 0 ) 2023-11-15 19:55:23,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700078110466 as table=testCompactionWithHFileLink 2023-11-15 19:55:23,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-15 19:55:23,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-15 19:55:23,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-15 19:55:23,710 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-15 19:55:23,711 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-15 19:55:23,711 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-15 19:55:23,712 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-15 19:55:23,718 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700078110466" table: "testCompactionWithHFileLink" creation_time: 1700078110476 type: FLUSH version: 2 ttl: 0 2023-11-15 19:55:23,719 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink 2023-11-15 19:55:23,724 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-15 19:55:23,728 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115ba7aefb65b2e4e4695982e821e82e27e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115ba7aefb65b2e4e4695982e821e82e27e 2023-11-15 19:55:23,729 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311159d1735222450497fb9a9d940c3f79bb3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311159d1735222450497fb9a9d940c3f79bb3 2023-11-15 19:55:23,730 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115a1cf4d7c1e694b2f9c7fd99b157c2eb7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115a1cf4d7c1e694b2f9c7fd99b157c2eb7 2023-11-15 19:55:23,730 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,733 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,736 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,739 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,742 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,744 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,747 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,750 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,753 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,756 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,759 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,762 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a of snapshot=snaptb-1700078110466 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-15 19:55:23,767 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311152b22f703cff740298571cf823fa0494e_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311152b22f703cff740298571cf823fa0494e_del 2023-11-15 19:55:23,768 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115cd0c84215ae94b019117d13a423eceba_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231115cd0c84215ae94b019117d13a423eceba_del 2023-11-15 19:55:23,769 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311150e1a7ef868294ccdaa8a27a0922b3783_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311150e1a7ef868294ccdaa8a27a0922b3783_del 2023-11-15 19:55:23,769 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:23,769 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:23,769 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:23,773 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/212e05726fb44a76b59db870d7229c97 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/212e05726fb44a76b59db870d7229c97 2023-11-15 19:55:23,773 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/32438f42fb2e4ab0a709fc5fe3535db1_SeqId_29_ 2023-11-15 19:55:23,773 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/e735869ef17a40cf8bb315e8c0ad2ec5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/e735869ef17a40cf8bb315e8c0ad2ec5 2023-11-15 19:55:23,774 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/d2f0727e0e0b424893c040755a5de428_SeqId_29_ 2023-11-15 19:55:23,774 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dfe0e9e5ff9144d99c4c112f2fd49160 of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,775 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6380634819114f198071948df3b4034f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/6380634819114f198071948df3b4034f 2023-11-15 19:55:23,775 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3eedfd16a6f3482b91e094c39d26c83a of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,775 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/9aeb6343b55a4f7b8bee5308eb98b2aa_SeqId_29_ 2023-11-15 19:55:23,775 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ca1d9efb973447ea9e22ae97043c57b2 of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,778 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eb77a11fb1c3474d82620ba1775b9499 of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,779 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a227fad1417c4ae3a61de048caa71738 of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,779 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 99033ab409ee47738c5f6c271e062d2d of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,782 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9af185d4b5a4b56b230e555e2323e14 of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,783 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ac3d3fc1e17e4722bca5cd17bac407b2 of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,783 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f0ac4c965f77433181c643b74a2314a5 of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,786 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a31b252731994341ae8806e6997991b7 of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,787 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c58e580fe9a041bda868d5daf52ffcfd of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,788 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 95433af143e1498490dcb4505637f679 of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,792 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/be2d9c144a78447e8c9be5133b16f5d4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/be2d9c144a78447e8c9be5133b16f5d4 2023-11-15 19:55:23,792 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4dd4616568e740299cf5a320377d72f4 of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,793 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/df2cfae58ff344929e65b31a45d71419 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/df2cfae58ff344929e65b31a45d71419 2023-11-15 19:55:23,793 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0036664ccd1142d2a132bdd8c4c8e41a of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,793 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/c72c04a9be2b4585a9ad28fe1a606575 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/c72c04a9be2b4585a9ad28fe1a606575 2023-11-15 19:55:23,793 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6f387b3c905d439484d967bae34514c0 of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,796 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d2accd1fcd03476fac40c3527bef764d of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,797 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 477d6375222c4c1eb5e8b83f1f31a72e of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,798 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 430d3cae0a474f2f8868f33e72d65c98 of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,800 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5af6f3ff8c1f4e569fe84898b3cf9ecf of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,801 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 22e8336c0e1e46bab0730aff8e33aeb6 of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,801 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 380e33f7addc45d28d9b9bd53251bcd1 of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,803 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d376d72748844c7b9f194c186d74bf6e of snapshot=snaptb-1700078110466 to region=622d6f4f194d5d320660fd1dcc1995da table=testCompactionWithHFileLink 2023-11-15 19:55:23,805 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e882d6befa654f1395c4447af18b0b39 of snapshot=snaptb-1700078110466 to region=663dfc0e063cc7d4ca1e0b1843d16ec8 table=testCompactionWithHFileLink 2023-11-15 19:55:23,805 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 704e7fcb4bf04ddabffcfde79fba0973 of snapshot=snaptb-1700078110466 to region=65fdc9444c3e3ebe54107538d8fc3b04 table=testCompactionWithHFileLink 2023-11-15 19:55:23,809 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700078110466" table: "testCompactionWithHFileLink" creation_time: 1700078110476 type: FLUSH version: 2 ttl: 0 2023-11-15 19:55:23,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700078123810"}]},"ts":"9223372036854775807"} 2023-11-15 19:55:23,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700078123810"}]},"ts":"9223372036854775807"} 2023-11-15 19:55:23,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700078123810"}]},"ts":"9223372036854775807"} 2023-11-15 19:55:23,812 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-15 19:55:23,813 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 622d6f4f194d5d320660fd1dcc1995da, NAME => 'testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 65fdc9444c3e3ebe54107538d8fc3b04, NAME => 'testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 663dfc0e063cc7d4ca1e0b1843d16ec8, NAME => 'testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.', STARTKEY => '2', ENDKEY => ''}] 2023-11-15 19:55:23,813 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078123811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078123811"}]},"ts":"1700078123811"} 2023-11-15 19:55:23,813 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078123811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078123811"}]},"ts":"1700078123811"} 2023-11-15 19:55:23,813 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078123811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078123811"}]},"ts":"1700078123811"} 2023-11-15 19:55:23,814 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-15 19:55:23,815 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-15 19:55:23,815 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 622d6f4f194d5d320660fd1dcc1995da, NAME => 'testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 65fdc9444c3e3ebe54107538d8fc3b04, NAME => 'testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 663dfc0e063cc7d4ca1e0b1843d16ec8, NAME => 'testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.', STARTKEY => '2', ENDKEY => ''}] 2023-11-15 19:55:23,815 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700078110466 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-15 19:55:23,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700078110466" table: "testCompactionWithHFileLink" creation_time: 1700078110476 type: FLUSH version: 2 ttl: 0 ) in 525 msec 2023-11-15 19:55:23,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-15 19:55:23,905 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-15 19:55:23,905 INFO [Listener at localhost/43577] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:23,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1700078110466-1700078122137" 2023-11-15 19:55:23,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700078110466-1700078122137 2023-11-15 19:55:23,915 INFO [Listener at localhost/43577] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-15 19:55:23,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-15 19:55:23,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-15 19:55:23,931 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-15 19:55:23,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-15 19:55:23,931 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078123931"}]},"ts":"1700078123931"} 2023-11-15 19:55:23,932 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-15 19:55:23,935 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-15 19:55:23,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN}] 2023-11-15 19:55:23,936 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN 2023-11-15 19:55:23,936 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN 2023-11-15 19:55:23,936 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN 2023-11-15 19:55:23,937 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-15 19:55:23,937 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-15 19:55:23,937 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-15 19:55:24,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-15 19:55:24,088 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=622d6f4f194d5d320660fd1dcc1995da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:24,088 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=65fdc9444c3e3ebe54107538d8fc3b04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:24,088 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=663dfc0e063cc7d4ca1e0b1843d16ec8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:24,089 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078124088"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078124088"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078124088"}]},"ts":"1700078124088"} 2023-11-15 19:55:24,089 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078124088"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078124088"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078124088"}]},"ts":"1700078124088"} 2023-11-15 19:55:24,089 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078124088"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078124088"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078124088"}]},"ts":"1700078124088"} 2023-11-15 19:55:24,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 622d6f4f194d5d320660fd1dcc1995da, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:24,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 663dfc0e063cc7d4ca1e0b1843d16ec8, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:24,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 65fdc9444c3e3ebe54107538d8fc3b04, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:24,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-15 19:55:24,242 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:24,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:24,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 622d6f4f194d5d320660fd1dcc1995da, NAME => 'testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.', STARTKEY => '', ENDKEY => '1'} 2023-11-15 19:55:24,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:24,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,246 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,247 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:24,247 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:24,247 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d6f4f194d5d320660fd1dcc1995da columnFamilyName family1 2023-11-15 19:55:24,256 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-a31b252731994341ae8806e6997991b7 2023-11-15 19:55:24,262 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-c9af185d4b5a4b56b230e555e2323e14 2023-11-15 19:55:24,266 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-dfe0e9e5ff9144d99c4c112f2fd49160 2023-11-15 19:55:24,271 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-eb77a11fb1c3474d82620ba1775b9499 2023-11-15 19:55:24,271 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(310): Store=622d6f4f194d5d320660fd1dcc1995da/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:24,271 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,272 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2 2023-11-15 19:55:24,272 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2 2023-11-15 19:55:24,272 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d6f4f194d5d320660fd1dcc1995da columnFamilyName family2 2023-11-15 19:55:24,279 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-4dd4616568e740299cf5a320377d72f4 2023-11-15 19:55:24,284 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-5af6f3ff8c1f4e569fe84898b3cf9ecf 2023-11-15 19:55:24,289 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d2accd1fcd03476fac40c3527bef764d 2023-11-15 19:55:24,294 DEBUG [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d376d72748844c7b9f194c186d74bf6e 2023-11-15 19:55:24,294 INFO [StoreOpener-622d6f4f194d5d320660fd1dcc1995da-1] regionserver.HStore(310): Store=622d6f4f194d5d320660fd1dcc1995da/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:24,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:24,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:55:24,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 622d6f4f194d5d320660fd1dcc1995da; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61045306, jitterRate=-0.0903540551662445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:24,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:24,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da., pid=101, masterSystemTime=1700078124242 2023-11-15 19:55:24,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:55:24,300 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-15 19:55:24,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:55:24,300 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-15 19:55:24,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:24,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:24,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:24,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 663dfc0e063cc7d4ca1e0b1843d16ec8, NAME => 'testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.', STARTKEY => '2', ENDKEY => ''} 2023-11-15 19:55:24,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,302 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=622d6f4f194d5d320660fd1dcc1995da, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:24,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:24,302 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078124302"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078124302"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078124302"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078124302"}]},"ts":"1700078124302"} 2023-11-15 19:55:24,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,304 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,305 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-15 19:55:24,305 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1912): 622d6f4f194d5d320660fd1dcc1995da/family1 is initiating minor compaction (all files) 2023-11-15 19:55:24,305 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 622d6f4f194d5d320660fd1dcc1995da/family1 in testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:24,305 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-dfe0e9e5ff9144d99c4c112f2fd49160, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-eb77a11fb1c3474d82620ba1775b9499, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-c9af185d4b5a4b56b230e555e2323e14, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-a31b252731994341ae8806e6997991b7] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp, totalSize=21.6 K 2023-11-15 19:55:24,305 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-15 19:55:24,305 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:24,305 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:24,305 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1912): 622d6f4f194d5d320660fd1dcc1995da/family2 is initiating minor compaction (all files) 2023-11-15 19:55:24,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=98 2023-11-15 19:55:24,305 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 622d6f4f194d5d320660fd1dcc1995da/family2 in testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:55:24,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 622d6f4f194d5d320660fd1dcc1995da, server=jenkins-hbase4.apache.org,42249,1700078002491 in 214 msec 2023-11-15 19:55:24,306 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-4dd4616568e740299cf5a320377d72f4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d2accd1fcd03476fac40c3527bef764d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-5af6f3ff8c1f4e569fe84898b3cf9ecf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d376d72748844c7b9f194c186d74bf6e] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp, totalSize=20.4 K 2023-11-15 19:55:24,306 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 663dfc0e063cc7d4ca1e0b1843d16ec8 columnFamilyName family1 2023-11-15 19:55:24,306 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-dfe0e9e5ff9144d99c4c112f2fd49160, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103242 2023-11-15 19:55:24,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=622d6f4f194d5d320660fd1dcc1995da, ASSIGN in 370 msec 2023-11-15 19:55:24,309 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-4dd4616568e740299cf5a320377d72f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103242 2023-11-15 19:55:24,309 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d2accd1fcd03476fac40c3527bef764d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105049 2023-11-15 19:55:24,309 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-eb77a11fb1c3474d82620ba1775b9499, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105049 2023-11-15 19:55:24,310 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-5af6f3ff8c1f4e569fe84898b3cf9ecf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:24,310 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-c9af185d4b5a4b56b230e555e2323e14, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:24,310 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d376d72748844c7b9f194c186d74bf6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:24,311 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-a31b252731994341ae8806e6997991b7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:24,326 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-95433af143e1498490dcb4505637f679 2023-11-15 19:55:24,343 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-99033ab409ee47738c5f6c271e062d2d 2023-11-15 19:55:24,374 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-ca1d9efb973447ea9e22ae97043c57b2 2023-11-15 19:55:24,387 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] throttle.PressureAwareThroughputController(145): 622d6f4f194d5d320660fd1dcc1995da#family2#compaction#113 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:24,388 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-f0ac4c965f77433181c643b74a2314a5 2023-11-15 19:55:24,389 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 622d6f4f194d5d320660fd1dcc1995da#family1#compaction#114 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:24,390 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(310): Store=663dfc0e063cc7d4ca1e0b1843d16ec8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:24,390 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,391 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2 2023-11-15 19:55:24,391 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2 2023-11-15 19:55:24,391 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 663dfc0e063cc7d4ca1e0b1843d16ec8 columnFamilyName family2 2023-11-15 19:55:24,403 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-22e8336c0e1e46bab0730aff8e33aeb6 2023-11-15 19:55:24,408 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-430d3cae0a474f2f8868f33e72d65c98 2023-11-15 19:55:24,413 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-6f387b3c905d439484d967bae34514c0 2023-11-15 19:55:24,417 DEBUG [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-e882d6befa654f1395c4447af18b0b39 2023-11-15 19:55:24,418 INFO [StoreOpener-663dfc0e063cc7d4ca1e0b1843d16ec8-1] regionserver.HStore(310): Store=663dfc0e063cc7d4ca1e0b1843d16ec8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:24,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:24,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:55:24,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 663dfc0e063cc7d4ca1e0b1843d16ec8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58811411, jitterRate=-0.12364168465137482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:24,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:24,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8., pid=102, masterSystemTime=1700078124242 2023-11-15 19:55:24,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-15 19:55:24,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-15 19:55:24,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:24,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:24,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:24,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65fdc9444c3e3ebe54107538d8fc3b04, NAME => 'testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.', STARTKEY => '1', ENDKEY => '2'} 2023-11-15 19:55:24,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=663dfc0e063cc7d4ca1e0b1843d16ec8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:24,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700078124426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078124426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078124426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078124426"}]},"ts":"1700078124426"} 2023-11-15 19:55:24,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:24,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,427 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,428 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:24,429 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:24,429 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65fdc9444c3e3ebe54107538d8fc3b04 columnFamilyName family1 2023-11-15 19:55:24,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-11-15 19:55:24,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 663dfc0e063cc7d4ca1e0b1843d16ec8, server=jenkins-hbase4.apache.org,42249,1700078002491 in 336 msec 2023-11-15 19:55:24,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=663dfc0e063cc7d4ca1e0b1843d16ec8, ASSIGN in 494 msec 2023-11-15 19:55:24,440 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-3eedfd16a6f3482b91e094c39d26c83a 2023-11-15 19:55:24,446 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-a227fad1417c4ae3a61de048caa71738 2023-11-15 19:55:24,452 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-ac3d3fc1e17e4722bca5cd17bac407b2 2023-11-15 19:55:24,458 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-c58e580fe9a041bda868d5daf52ffcfd 2023-11-15 19:55:24,458 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(310): Store=65fdc9444c3e3ebe54107538d8fc3b04/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:24,458 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,459 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2 2023-11-15 19:55:24,459 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2 2023-11-15 19:55:24,459 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65fdc9444c3e3ebe54107538d8fc3b04 columnFamilyName family2 2023-11-15 19:55:24,474 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-0036664ccd1142d2a132bdd8c4c8e41a 2023-11-15 19:55:24,482 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-380e33f7addc45d28d9b9bd53251bcd1 2023-11-15 19:55:24,489 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-477d6375222c4c1eb5e8b83f1f31a72e 2023-11-15 19:55:24,500 DEBUG [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(539): loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-704e7fcb4bf04ddabffcfde79fba0973 2023-11-15 19:55:24,500 INFO [StoreOpener-65fdc9444c3e3ebe54107538d8fc3b04-1] regionserver.HStore(310): Store=65fdc9444c3e3ebe54107538d8fc3b04/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:24,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:24,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:55:24,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 65fdc9444c3e3ebe54107538d8fc3b04; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60449079, jitterRate=-0.09923852980136871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:24,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:24,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04., pid=103, masterSystemTime=1700078124242 2023-11-15 19:55:24,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-15 19:55:24,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-15 19:55:24,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:24,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:24,508 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=65fdc9444c3e3ebe54107538d8fc3b04, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:24,509 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078124508"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078124508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078124508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078124508"}]},"ts":"1700078124508"} 2023-11-15 19:55:24,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-11-15 19:55:24,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 65fdc9444c3e3ebe54107538d8fc3b04, server=jenkins-hbase4.apache.org,42249,1700078002491 in 419 msec 2023-11-15 19:55:24,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-11-15 19:55:24,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=65fdc9444c3e3ebe54107538d8fc3b04, ASSIGN in 576 msec 2023-11-15 19:55:24,514 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078124513"}]},"ts":"1700078124513"} 2023-11-15 19:55:24,515 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-15 19:55:24,516 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-15 19:55:24,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 596 msec 2023-11-15 19:55:24,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-15 19:55:24,534 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-15 19:55:24,547 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:24,561 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:24,572 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:24,573 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:24,580 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-15 19:55:24,601 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-15 19:55:24,601 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:24,603 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(139): Connect 0x345a3dae to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:55:24,609 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@565de4d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:55:24,609 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:24,609 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:24,609 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:25,118 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115657b65d9469740d48077ea541210ff0b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231115657b65d9469740d48077ea541210ff0b 2023-11-15 19:55:25,119 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:25,131 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:55:25,134 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:55:25,141 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:55:25,144 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:55:25,156 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/92b068ef9b4c4e388ecb008c4e88e760 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-15 19:55:25,157 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/92b068ef9b4c4e388ecb008c4e88e760}] 2023-11-15 19:55:25,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/92b068ef9b4c4e388ecb008c4e88e760 for inclusion in 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:25,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-15 19:55:25,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-15 19:55:25,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:25,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115/family1/92b068ef9b4c4e388ecb008c4e88e760 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__gciun3gb0vqebf0eir1g8lp4id7hkjprpg6ijhufr7k4k0uoi1u20rljeuu3ov81/family1/92b068ef9b4c4e388ecb008c4e88e760 2023-11-15 19:55:25,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__gciun3gb0vqebf0eir1g8lp4id7hkjprpg6ijhufr7k4k0uoi1u20rljeuu3ov81/family1/92b068ef9b4c4e388ecb008c4e88e760 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_ 2023-11-15 19:55:25,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__gciun3gb0vqebf0eir1g8lp4id7hkjprpg6ijhufr7k4k0uoi1u20rljeuu3ov81/family1/92b068ef9b4c4e388ecb008c4e88e760 into 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_ - updating store file list. 2023-11-15 19:55:25,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_ into 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 2023-11-15 19:55:25,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__gciun3gb0vqebf0eir1g8lp4id7hkjprpg6ijhufr7k4k0uoi1u20rljeuu3ov81/family1/92b068ef9b4c4e388ecb008c4e88e760 into 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_) 2023-11-15 19:55:25,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__gciun3gb0vqebf0eir1g8lp4id7hkjprpg6ijhufr7k4k0uoi1u20rljeuu3ov81/family1/92b068ef9b4c4e388ecb008c4e88e760 2023-11-15 19:55:25,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:25,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-15 19:55:25,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(1912): 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 is initiating minor compaction (all files) 2023-11-15 19:55:25,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@78b1f58c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-15 19:55:25,178 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:25,178 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:25,180 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311152770423192a9468086db80a52dd68d90 2023-11-15 19:55:25,181 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111575762a8fc70344a5a4a02328c6797dbc 2023-11-15 19:55:25,182 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231115a157fc4c1c8d4c20bd6ec6f897d922c1 2023-11-15 19:55:25,183 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231115d0f970f9f9e24aa3a93d3978b30a30ed 2023-11-15 19:55:25,183 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-15 19:55:25,183 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231115' 2023-11-15 19:55:25,184 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:25,513 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115479be67ff01c4a918cc8876007bde224 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231115479be67ff01c4a918cc8876007bde224 2023-11-15 19:55:25,514 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:25,517 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115378b71b92387443595d6b7bf8ac9df2c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231115378b71b92387443595d6b7bf8ac9df2c 2023-11-15 19:55:25,518 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:25,549 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/e00a4d5ee85d466d9c089731a82fa8ab first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-15 19:55:25,550 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=32 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/e00a4d5ee85d466d9c089731a82fa8ab}] 2023-11-15 19:55:25,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/e00a4d5ee85d466d9c089731a82fa8ab for inclusion in 622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:25,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-15 19:55:25,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last=1 2023-11-15 19:55:25,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:25,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115/family1/e00a4d5ee85d466d9c089731a82fa8ab to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__crcbh8o5jltithcp2tcacvglmurcrvltr5vpoh81faai71bu7u2plh62dmnft3m3/family1/e00a4d5ee85d466d9c089731a82fa8ab 2023-11-15 19:55:25,557 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/be9504ef650941bd9a18d74ff0d50173 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-15 19:55:25,558 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/be9504ef650941bd9a18d74ff0d50173}] 2023-11-15 19:55:25,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__crcbh8o5jltithcp2tcacvglmurcrvltr5vpoh81faai71bu7u2plh62dmnft3m3/family1/e00a4d5ee85d466d9c089731a82fa8ab as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/fbb211e74fdc472596fda978297e1612_SeqId_34_ 2023-11-15 19:55:25,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/be9504ef650941bd9a18d74ff0d50173 for inclusion in 65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:25,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__crcbh8o5jltithcp2tcacvglmurcrvltr5vpoh81faai71bu7u2plh62dmnft3m3/family1/e00a4d5ee85d466d9c089731a82fa8ab into 622d6f4f194d5d320660fd1dcc1995da/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/fbb211e74fdc472596fda978297e1612_SeqId_34_ - updating store file list. 2023-11-15 19:55:25,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-15 19:55:25,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-15 19:55:25,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:25,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115/family1/be9504ef650941bd9a18d74ff0d50173 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__beka5ia525kia14re92gdio61dc5vngd7cs0ginpo03kjv8420mc2aiai64u84p4/family1/be9504ef650941bd9a18d74ff0d50173 2023-11-15 19:55:25,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/fbb211e74fdc472596fda978297e1612_SeqId_34_ into 622d6f4f194d5d320660fd1dcc1995da/family1 2023-11-15 19:55:25,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__crcbh8o5jltithcp2tcacvglmurcrvltr5vpoh81faai71bu7u2plh62dmnft3m3/family1/e00a4d5ee85d466d9c089731a82fa8ab into 622d6f4f194d5d320660fd1dcc1995da/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/fbb211e74fdc472596fda978297e1612_SeqId_34_) 2023-11-15 19:55:25,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__crcbh8o5jltithcp2tcacvglmurcrvltr5vpoh81faai71bu7u2plh62dmnft3m3/family1/e00a4d5ee85d466d9c089731a82fa8ab 2023-11-15 19:55:25,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__beka5ia525kia14re92gdio61dc5vngd7cs0ginpo03kjv8420mc2aiai64u84p4/family1/be9504ef650941bd9a18d74ff0d50173 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_ 2023-11-15 19:55:25,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__beka5ia525kia14re92gdio61dc5vngd7cs0ginpo03kjv8420mc2aiai64u84p4/family1/be9504ef650941bd9a18d74ff0d50173 into 65fdc9444c3e3ebe54107538d8fc3b04/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_ - updating store file list. 2023-11-15 19:55:25,567 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:25,568 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:25,570 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231115170ff76aeb5e47b88756c7a170877724 2023-11-15 19:55:25,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_ into 65fdc9444c3e3ebe54107538d8fc3b04/family1 2023-11-15 19:55:25,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__beka5ia525kia14re92gdio61dc5vngd7cs0ginpo03kjv8420mc2aiai64u84p4/family1/be9504ef650941bd9a18d74ff0d50173 into 65fdc9444c3e3ebe54107538d8fc3b04/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_) 2023-11-15 19:55:25,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testCompactionWithHFileLink__beka5ia525kia14re92gdio61dc5vngd7cs0ginpo03kjv8420mc2aiai64u84p4/family1/be9504ef650941bd9a18d74ff0d50173 2023-11-15 19:55:25,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:25,571 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311153ead0aea1c6b4255b921fd3c71ce34d2 2023-11-15 19:55:25,572 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311156e88483f46be4182ab708323783f7ea5 2023-11-15 19:55:25,573 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231115d916256e763040cfa2c659725a07650a 2023-11-15 19:55:25,573 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-15 19:55:25,573 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231115' 2023-11-15 19:55:25,574 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:25,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-15 19:55:25,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(1912): 65fdc9444c3e3ebe54107538d8fc3b04/family1 is initiating minor compaction (all files) 2023-11-15 19:55:25,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@20dc9174; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-15 19:55:25,576 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:25,577 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:25,578 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115493d2a359b1f4f91878eadf77032a102 2023-11-15 19:55:25,579 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115ab98e67e5827469d87bf61f423f9167c 2023-11-15 19:55:25,580 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115dbda2ab2b35640c6a5a59586ecc5ebc1 2023-11-15 19:55:25,580 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231115e15ed551275b40e1b484260e8bec696a 2023-11-15 19:55:25,580 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-15 19:55:25,581 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231115' 2023-11-15 19:55:25,581 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231115 for table='testCompactionWithHFileLink' and column='family1' 2023-11-15 19:55:25,581 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-15 19:55:25,583 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:25,585 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:25,588 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:25,589 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:25,595 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:25,596 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:25,609 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family2/177a03e7c8bc4324b06ab9ad94e633b2 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/177a03e7c8bc4324b06ab9ad94e633b2 2023-11-15 19:55:25,612 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/.tmp/family1/7834996c83804487b0768c85456c23c7 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/7834996c83804487b0768c85456c23c7 2023-11-15 19:55:25,614 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=292 (was 238) - Thread LEAK? -, OpenFileDescriptor=800 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 102) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=1130 (was 849) - AvailableMemoryMB LEAK? - 2023-11-15 19:55:25,617 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 622d6f4f194d5d320660fd1dcc1995da/family2 of 622d6f4f194d5d320660fd1dcc1995da into 177a03e7c8bc4324b06ab9ad94e633b2(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:25,617 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:25,617 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da., storeName=622d6f4f194d5d320660fd1dcc1995da/family2, priority=12, startTime=1700078124300; duration=1sec 2023-11-15 19:55:25,617 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-15 19:55:25,617 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 in testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:25,617 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-ca1d9efb973447ea9e22ae97043c57b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-99033ab409ee47738c5f6c271e062d2d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-f0ac4c965f77433181c643b74a2314a5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-95433af143e1498490dcb4505637f679, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp, totalSize=28.9 K 2023-11-15 19:55:25,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-4dd4616568e740299cf5a320377d72f4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d2accd1fcd03476fac40c3527bef764d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-5af6f3ff8c1f4e569fe84898b3cf9ecf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d376d72748844c7b9f194c186d74bf6e] to archive 2023-11-15 19:55:25,622 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-ca1d9efb973447ea9e22ae97043c57b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103245 2023-11-15 19:55:25,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:25,622 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 622d6f4f194d5d320660fd1dcc1995da/family1 of 622d6f4f194d5d320660fd1dcc1995da into 7834996c83804487b0768c85456c23c7(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:25,622 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:55:25,622 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da., storeName=622d6f4f194d5d320660fd1dcc1995da/family1, priority=12, startTime=1700078124300; duration=1sec 2023-11-15 19:55:25,622 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-15 19:55:25,623 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-99033ab409ee47738c5f6c271e062d2d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:25,623 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 65fdc9444c3e3ebe54107538d8fc3b04/family1 in testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:25,623 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-3eedfd16a6f3482b91e094c39d26c83a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-a227fad1417c4ae3a61de048caa71738, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-ac3d3fc1e17e4722bca5cd17bac407b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-c58e580fe9a041bda868d5daf52ffcfd, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp, totalSize=28.9 K 2023-11-15 19:55:25,623 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-f0ac4c965f77433181c643b74a2314a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:25,624 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-3eedfd16a6f3482b91e094c39d26c83a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103244 2023-11-15 19:55:25,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-4dd4616568e740299cf5a320377d72f4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-4dd4616568e740299cf5a320377d72f4 2023-11-15 19:55:25,624 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-95433af143e1498490dcb4505637f679, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108657 2023-11-15 19:55:25,625 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-a227fad1417c4ae3a61de048caa71738, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:25,625 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting 24c555a379c346b28e353a8b2de111b6_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700078103245 2023-11-15 19:55:25,625 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-ac3d3fc1e17e4722bca5cd17bac407b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:25,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d2accd1fcd03476fac40c3527bef764d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d2accd1fcd03476fac40c3527bef764d 2023-11-15 19:55:25,627 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-c58e580fe9a041bda868d5daf52ffcfd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:25,628 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 50b4fc99b3424c23aee097d87195889c_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700078103244 2023-11-15 19:55:25,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-5af6f3ff8c1f4e569fe84898b3cf9ecf to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-5af6f3ff8c1f4e569fe84898b3cf9ecf 2023-11-15 19:55:25,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d376d72748844c7b9f194c186d74bf6e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family2/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-d376d72748844c7b9f194c186d74bf6e 2023-11-15 19:55:25,631 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=290, OpenFileDescriptor=796, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=172, AvailableMemoryMB=1130 2023-11-15 19:55:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-15 19:55:25,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-15 19:55:25,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-15 19:55:25,644 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-15 19:55:25,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 10 msec 2023-11-15 19:55:25,650 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] throttle.PressureAwareThroughputController(145): 663dfc0e063cc7d4ca1e0b1843d16ec8#family1#compaction#115 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:25,658 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 65fdc9444c3e3ebe54107538d8fc3b04#family1#compaction#116 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:25,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-dfe0e9e5ff9144d99c4c112f2fd49160, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-eb77a11fb1c3474d82620ba1775b9499, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-c9af185d4b5a4b56b230e555e2323e14, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-a31b252731994341ae8806e6997991b7] to archive 2023-11-15 19:55:25,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:25,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-dfe0e9e5ff9144d99c4c112f2fd49160 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-dfe0e9e5ff9144d99c4c112f2fd49160 2023-11-15 19:55:25,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-eb77a11fb1c3474d82620ba1775b9499 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-eb77a11fb1c3474d82620ba1775b9499 2023-11-15 19:55:25,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-c9af185d4b5a4b56b230e555e2323e14 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-c9af185d4b5a4b56b230e555e2323e14 2023-11-15 19:55:25,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-a31b252731994341ae8806e6997991b7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/family1/testCompactionWithHFileLink=622d6f4f194d5d320660fd1dcc1995da-a31b252731994341ae8806e6997991b7 2023-11-15 19:55:25,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-15 19:55:25,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-15 19:55:25,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-15 19:55:25,746 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:55:25,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-15 19:55:25,747 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:55:25,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-15 19:55:25,748 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546 empty. 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078 empty. 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5 empty. 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:25,749 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:25,749 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-15 19:55:25,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-15 19:55:26,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-15 19:55:26,156 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-15 19:55:26,158 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => adece068f30ad1573248e55d1a9945a5, NAME => 'ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:26,158 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e9fedf55069b3b4497e68f08fb45546, NAME => 'ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:26,158 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3e25eb704f1ec32bbf32935b51161078, NAME => 'ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:26,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-15 19:55:26,477 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family1/5e8873e38fc64f78a37a877bb6fd70a4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/5e8873e38fc64f78a37a877bb6fd70a4 2023-11-15 19:55:26,481 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 65fdc9444c3e3ebe54107538d8fc3b04/family1 of 65fdc9444c3e3ebe54107538d8fc3b04 into 5e8873e38fc64f78a37a877bb6fd70a4(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:55:26,481 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:26,481 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700078125574; duration=0sec 2023-11-15 19:55:26,481 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-15 19:55:26,482 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-15 19:55:26,483 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-15 19:55:26,483 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1912): 663dfc0e063cc7d4ca1e0b1843d16ec8/family2 is initiating minor compaction (all files) 2023-11-15 19:55:26,483 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 663dfc0e063cc7d4ca1e0b1843d16ec8/family2 in testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:55:26,483 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-6f387b3c905d439484d967bae34514c0, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-430d3cae0a474f2f8868f33e72d65c98, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-22e8336c0e1e46bab0730aff8e33aeb6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-e882d6befa654f1395c4447af18b0b39] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp, totalSize=20.4 K 2023-11-15 19:55:26,484 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-6f387b3c905d439484d967bae34514c0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103245 2023-11-15 19:55:26,484 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-430d3cae0a474f2f8868f33e72d65c98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:26,485 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-22e8336c0e1e46bab0730aff8e33aeb6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:26,485 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-e882d6befa654f1395c4447af18b0b39, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108657 2023-11-15 19:55:26,496 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 663dfc0e063cc7d4ca1e0b1843d16ec8#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:26,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-3eedfd16a6f3482b91e094c39d26c83a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-a227fad1417c4ae3a61de048caa71738, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-ac3d3fc1e17e4722bca5cd17bac407b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-c58e580fe9a041bda868d5daf52ffcfd, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_] to archive 2023-11-15 19:55:26,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:26,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-3eedfd16a6f3482b91e094c39d26c83a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-3eedfd16a6f3482b91e094c39d26c83a 2023-11-15 19:55:26,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-a227fad1417c4ae3a61de048caa71738 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-a227fad1417c4ae3a61de048caa71738 2023-11-15 19:55:26,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-ac3d3fc1e17e4722bca5cd17bac407b2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-ac3d3fc1e17e4722bca5cd17bac407b2 2023-11-15 19:55:26,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-c58e580fe9a041bda868d5daf52ffcfd to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-c58e580fe9a041bda868d5daf52ffcfd 2023-11-15 19:55:26,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family1/50b4fc99b3424c23aee097d87195889c_SeqId_34_ 2023-11-15 19:55:26,564 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:26,564 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing adece068f30ad1573248e55d1a9945a5, disabling compactions & flushes 2023-11-15 19:55:26,564 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:26,564 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:26,564 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. after waiting 0 ms 2023-11-15 19:55:26,564 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:26,564 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 3e25eb704f1ec32bbf32935b51161078, disabling compactions & flushes 2023-11-15 19:55:26,565 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. after waiting 0 ms 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:26,565 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:26,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:26,566 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 5e9fedf55069b3b4497e68f08fb45546, disabling compactions & flushes 2023-11-15 19:55:26,566 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:26,566 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:26,566 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. after waiting 0 ms 2023-11-15 19:55:26,566 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:26,566 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:26,566 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:26,568 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:55:26,569 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700078126569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078126569"}]},"ts":"1700078126569"} 2023-11-15 19:55:26,569 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700078126569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078126569"}]},"ts":"1700078126569"} 2023-11-15 19:55:26,569 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700078126569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078126569"}]},"ts":"1700078126569"} 2023-11-15 19:55:26,571 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-15 19:55:26,571 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:55:26,571 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078126571"}]},"ts":"1700078126571"} 2023-11-15 19:55:26,572 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-15 19:55:26,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5e9fedf55069b3b4497e68f08fb45546, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3e25eb704f1ec32bbf32935b51161078, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=adece068f30ad1573248e55d1a9945a5, ASSIGN}] 2023-11-15 19:55:26,586 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=adece068f30ad1573248e55d1a9945a5, ASSIGN 2023-11-15 19:55:26,586 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3e25eb704f1ec32bbf32935b51161078, ASSIGN 2023-11-15 19:55:26,586 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5e9fedf55069b3b4497e68f08fb45546, ASSIGN 2023-11-15 19:55:26,586 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=adece068f30ad1573248e55d1a9945a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:26,587 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3e25eb704f1ec32bbf32935b51161078, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:26,587 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5e9fedf55069b3b4497e68f08fb45546, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:26,740 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=adece068f30ad1573248e55d1a9945a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:26,740 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3e25eb704f1ec32bbf32935b51161078, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:26,740 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5e9fedf55069b3b4497e68f08fb45546, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:26,740 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700078126740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078126740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078126740"}]},"ts":"1700078126740"} 2023-11-15 19:55:26,740 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700078126740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078126740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078126740"}]},"ts":"1700078126740"} 2023-11-15 19:55:26,740 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700078126740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078126740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078126740"}]},"ts":"1700078126740"} 2023-11-15 19:55:26,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure adece068f30ad1573248e55d1a9945a5, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:26,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 3e25eb704f1ec32bbf32935b51161078, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:26,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 5e9fedf55069b3b4497e68f08fb45546, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:26,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-15 19:55:26,873 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family1/768c80dbd1ec44809ed203b6417ccf12 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/768c80dbd1ec44809ed203b6417ccf12 2023-11-15 19:55:26,877 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 663dfc0e063cc7d4ca1e0b1843d16ec8/family1 of 663dfc0e063cc7d4ca1e0b1843d16ec8 into 768c80dbd1ec44809ed203b6417ccf12(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:26,877 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:26,877 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700078125176; duration=1sec 2023-11-15 19:55:26,877 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-15 19:55:26,877 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-15 19:55:26,879 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-15 19:55:26,879 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1912): 65fdc9444c3e3ebe54107538d8fc3b04/family2 is initiating minor compaction (all files) 2023-11-15 19:55:26,879 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 65fdc9444c3e3ebe54107538d8fc3b04/family2 in testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:55:26,879 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-0036664ccd1142d2a132bdd8c4c8e41a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-477d6375222c4c1eb5e8b83f1f31a72e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-380e33f7addc45d28d9b9bd53251bcd1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-704e7fcb4bf04ddabffcfde79fba0973] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp, totalSize=20.4 K 2023-11-15 19:55:26,880 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-0036664ccd1142d2a132bdd8c4c8e41a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078103244 2023-11-15 19:55:26,880 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-477d6375222c4c1eb5e8b83f1f31a72e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078105050 2023-11-15 19:55:26,881 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-380e33f7addc45d28d9b9bd53251bcd1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078106839 2023-11-15 19:55:26,881 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-704e7fcb4bf04ddabffcfde79fba0973, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078108656 2023-11-15 19:55:26,891 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] throttle.PressureAwareThroughputController(145): 65fdc9444c3e3ebe54107538d8fc3b04#family2#compaction#118 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:26,893 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:26,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:26,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e25eb704f1ec32bbf32935b51161078, NAME => 'ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078.', STARTKEY => '1', ENDKEY => '2'} 2023-11-15 19:55:26,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:26,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,897 INFO [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,898 DEBUG [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1 2023-11-15 19:55:26,898 DEBUG [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1 2023-11-15 19:55:26,898 INFO [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e25eb704f1ec32bbf32935b51161078 columnFamilyName family1 2023-11-15 19:55:26,900 INFO [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] regionserver.HStore(310): Store=3e25eb704f1ec32bbf32935b51161078/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:26,900 INFO [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,901 DEBUG [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2 2023-11-15 19:55:26,902 DEBUG [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2 2023-11-15 19:55:26,902 INFO [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e25eb704f1ec32bbf32935b51161078 columnFamilyName family2 2023-11-15 19:55:26,906 INFO [StoreOpener-3e25eb704f1ec32bbf32935b51161078-1] regionserver.HStore(310): Store=3e25eb704f1ec32bbf32935b51161078/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:26,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:26,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:55:26,910 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/.tmp/family2/7a1df322047749208ae6471604e63d42 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/7a1df322047749208ae6471604e63d42 2023-11-15 19:55:26,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:26,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3e25eb704f1ec32bbf32935b51161078; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62019351, jitterRate=-0.07583965361118317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:26,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:26,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078., pid=110, masterSystemTime=1700078126893 2023-11-15 19:55:26,915 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 65fdc9444c3e3ebe54107538d8fc3b04/family2 of 65fdc9444c3e3ebe54107538d8fc3b04 into 7a1df322047749208ae6471604e63d42(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:55:26,915 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:55:26,915 INFO [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04., storeName=65fdc9444c3e3ebe54107538d8fc3b04/family2, priority=12, startTime=1700078124507; duration=0sec 2023-11-15 19:55:26,915 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-15 19:55:26,915 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-15 19:55:26,915 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-15 19:55:26,916 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-15 19:55:26,916 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. because compaction request was cancelled 2023-11-15 19:55:26,916 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-15 19:55:26,916 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-15 19:55:26,916 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-15 19:55:26,916 DEBUG [RS:0;jenkins-hbase4:42249-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. because compaction request was cancelled 2023-11-15 19:55:26,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-0036664ccd1142d2a132bdd8c4c8e41a, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-477d6375222c4c1eb5e8b83f1f31a72e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-380e33f7addc45d28d9b9bd53251bcd1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-704e7fcb4bf04ddabffcfde79fba0973] to archive 2023-11-15 19:55:26,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:26,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:26,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:26,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:26,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adece068f30ad1573248e55d1a9945a5, NAME => 'ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5.', STARTKEY => '2', ENDKEY => ''} 2023-11-15 19:55:26,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,918 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3e25eb704f1ec32bbf32935b51161078, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:26,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:26,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,919 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700078126918"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078126918"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078126918"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078126918"}]},"ts":"1700078126918"} 2023-11-15 19:55:26,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-0036664ccd1142d2a132bdd8c4c8e41a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-0036664ccd1142d2a132bdd8c4c8e41a 2023-11-15 19:55:26,920 INFO [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-477d6375222c4c1eb5e8b83f1f31a72e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-477d6375222c4c1eb5e8b83f1f31a72e 2023-11-15 19:55:26,921 DEBUG [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1 2023-11-15 19:55:26,921 DEBUG [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1 2023-11-15 19:55:26,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=107 2023-11-15 19:55:26,922 INFO [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adece068f30ad1573248e55d1a9945a5 columnFamilyName family1 2023-11-15 19:55:26,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 3e25eb704f1ec32bbf32935b51161078, server=jenkins-hbase4.apache.org,42249,1700078002491 in 178 msec 2023-11-15 19:55:26,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-380e33f7addc45d28d9b9bd53251bcd1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-380e33f7addc45d28d9b9bd53251bcd1 2023-11-15 19:55:26,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3e25eb704f1ec32bbf32935b51161078, ASSIGN in 338 msec 2023-11-15 19:55:26,923 INFO [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] regionserver.HStore(310): Store=adece068f30ad1573248e55d1a9945a5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:26,923 INFO [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-704e7fcb4bf04ddabffcfde79fba0973 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/family2/testCompactionWithHFileLink=65fdc9444c3e3ebe54107538d8fc3b04-704e7fcb4bf04ddabffcfde79fba0973 2023-11-15 19:55:26,924 DEBUG [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2 2023-11-15 19:55:26,924 DEBUG [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2 2023-11-15 19:55:26,925 INFO [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adece068f30ad1573248e55d1a9945a5 columnFamilyName family2 2023-11-15 19:55:26,925 INFO [StoreOpener-adece068f30ad1573248e55d1a9945a5-1] regionserver.HStore(310): Store=adece068f30ad1573248e55d1a9945a5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:26,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-ca1d9efb973447ea9e22ae97043c57b2, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-99033ab409ee47738c5f6c271e062d2d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-f0ac4c965f77433181c643b74a2314a5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-95433af143e1498490dcb4505637f679, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_] to archive 2023-11-15 19:55:26,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:26,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-ca1d9efb973447ea9e22ae97043c57b2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-ca1d9efb973447ea9e22ae97043c57b2 2023-11-15 19:55:26,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:26,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for adece068f30ad1573248e55d1a9945a5 2023-11-15 19:55:26,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-99033ab409ee47738c5f6c271e062d2d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-99033ab409ee47738c5f6c271e062d2d 2023-11-15 19:55:26,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-f0ac4c965f77433181c643b74a2314a5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-f0ac4c965f77433181c643b74a2314a5 2023-11-15 19:55:26,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:26,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened adece068f30ad1573248e55d1a9945a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71046566, jitterRate=0.058676332235336304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:26,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-95433af143e1498490dcb4505637f679 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-95433af143e1498490dcb4505637f679 2023-11-15 19:55:26,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:26,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5., pid=109, masterSystemTime=1700078126893 2023-11-15 19:55:26,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family1/24c555a379c346b28e353a8b2de111b6_SeqId_34_ 2023-11-15 19:55:26,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:26,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:26,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:26,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e9fedf55069b3b4497e68f08fb45546, NAME => 'ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546.', STARTKEY => '', ENDKEY => '1'} 2023-11-15 19:55:26,934 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=adece068f30ad1573248e55d1a9945a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:26,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700078126934"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078126934"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078126934"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078126934"}]},"ts":"1700078126934"} 2023-11-15 19:55:26,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:26,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,935 INFO [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=108 2023-11-15 19:55:26,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure adece068f30ad1573248e55d1a9945a5, server=jenkins-hbase4.apache.org,42249,1700078002491 in 194 msec 2023-11-15 19:55:26,936 DEBUG [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1 2023-11-15 19:55:26,937 DEBUG [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1 2023-11-15 19:55:26,937 INFO [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e9fedf55069b3b4497e68f08fb45546 columnFamilyName family1 2023-11-15 19:55:26,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=adece068f30ad1573248e55d1a9945a5, ASSIGN in 352 msec 2023-11-15 19:55:26,938 INFO [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] regionserver.HStore(310): Store=5e9fedf55069b3b4497e68f08fb45546/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:26,938 INFO [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,939 DEBUG [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2 2023-11-15 19:55:26,939 DEBUG [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2 2023-11-15 19:55:26,939 INFO [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e9fedf55069b3b4497e68f08fb45546 columnFamilyName family2 2023-11-15 19:55:26,940 INFO [StoreOpener-5e9fedf55069b3b4497e68f08fb45546-1] regionserver.HStore(310): Store=5e9fedf55069b3b4497e68f08fb45546/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:26,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:26,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:55:26,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:26,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e9fedf55069b3b4497e68f08fb45546; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73340511, jitterRate=0.09285877645015717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:26,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:26,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546., pid=111, masterSystemTime=1700078126893 2023-11-15 19:55:26,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:26,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:26,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5e9fedf55069b3b4497e68f08fb45546, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:26,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700078126948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078126948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078126948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078126948"}]},"ts":"1700078126948"} 2023-11-15 19:55:26,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=106 2023-11-15 19:55:26,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 5e9fedf55069b3b4497e68f08fb45546, server=jenkins-hbase4.apache.org,42249,1700078002491 in 206 msec 2023-11-15 19:55:26,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-11-15 19:55:26,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5e9fedf55069b3b4497e68f08fb45546, ASSIGN in 367 msec 2023-11-15 19:55:26,953 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:55:26,953 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078126953"}]},"ts":"1700078126953"} 2023-11-15 19:55:26,954 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-15 19:55:26,956 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:55:26,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2120 sec 2023-11-15 19:55:27,526 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:55:27,566 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:55:27,566 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34b14ba5 to 127.0.0.1:50885 2023-11-15 19:55:27,566 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:55:27,567 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:55:27,567 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x345a3dae to 127.0.0.1:50885 2023-11-15 19:55:27,567 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:55:27,568 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:55:27,568 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21d1d175 to 127.0.0.1:50885 2023-11-15 19:55:27,568 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:55:27,717 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/.tmp/family2/48b78015214d43ebb9634393d618e59a as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/48b78015214d43ebb9634393d618e59a 2023-11-15 19:55:27,721 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 663dfc0e063cc7d4ca1e0b1843d16ec8/family2 of 663dfc0e063cc7d4ca1e0b1843d16ec8 into 48b78015214d43ebb9634393d618e59a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:27,721 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:55:27,721 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8., storeName=663dfc0e063cc7d4ca1e0b1843d16ec8/family2, priority=12, startTime=1700078124424; duration=1sec 2023-11-15 19:55:27,721 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:55:27,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-6f387b3c905d439484d967bae34514c0, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-430d3cae0a474f2f8868f33e72d65c98, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-22e8336c0e1e46bab0730aff8e33aeb6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-e882d6befa654f1395c4447af18b0b39] to archive 2023-11-15 19:55:27,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:27,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-6f387b3c905d439484d967bae34514c0 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-6f387b3c905d439484d967bae34514c0 2023-11-15 19:55:27,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-430d3cae0a474f2f8868f33e72d65c98 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-430d3cae0a474f2f8868f33e72d65c98 2023-11-15 19:55:27,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-22e8336c0e1e46bab0730aff8e33aeb6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-22e8336c0e1e46bab0730aff8e33aeb6 2023-11-15 19:55:27,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-e882d6befa654f1395c4447af18b0b39 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/family2/testCompactionWithHFileLink=663dfc0e063cc7d4ca1e0b1843d16ec8-e882d6befa654f1395c4447af18b0b39 2023-11-15 19:55:27,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-15 19:55:27,852 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-15 19:55:27,857 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:27,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:27,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:27,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:27,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-15 19:55:27,862 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-15 19:55:27,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:27,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-15 19:55:27,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-15 19:55:27,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:27,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:27,864 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:27,864 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:27,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:27,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:27,865 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:27,865 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:27,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:27,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:27,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:27,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:27,866 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-15 19:55:27,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-15 19:55:27,866 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-15 19:55:27,866 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:27,866 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-15 19:55:27,866 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:27,866 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:27,866 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:27,866 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:27,866 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. started... 2023-11-15 19:55:27,866 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:27,866 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. started... 2023-11-15 19:55:27,866 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. started... 2023-11-15 19:55:27,868 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing adece068f30ad1573248e55d1a9945a5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:27,868 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5e9fedf55069b3b4497e68f08fb45546 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:27,868 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3e25eb704f1ec32bbf32935b51161078 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:27,883 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311159e820b50762743eab1f970822ac261d6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311159e820b50762743eab1f970822ac261d6 2023-11-15 19:55:27,887 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/97ecc5450ff94f4fb91bf92e1739a314 2023-11-15 19:55:27,901 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115ce917a0719d04865972833cd7926b1a0 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231115ce917a0719d04865972833cd7926b1a0 2023-11-15 19:55:27,906 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/0d3101e14c6f4e84a7702a916fe99b89 2023-11-15 19:55:27,909 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/97ecc5450ff94f4fb91bf92e1739a314 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/97ecc5450ff94f4fb91bf92e1739a314 2023-11-15 19:55:27,912 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/97ecc5450ff94f4fb91bf92e1739a314, entries=4, sequenceid=5, filesize=5.4 K 2023-11-15 19:55:27,913 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/0d3101e14c6f4e84a7702a916fe99b89 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/0d3101e14c6f4e84a7702a916fe99b89 2023-11-15 19:55:27,916 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/0d3101e14c6f4e84a7702a916fe99b89, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:27,917 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5e9fedf55069b3b4497e68f08fb45546 in 49ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:27,917 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-15 19:55:27,918 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:27,918 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:27,918 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:28,283 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115627620409b9141238bf3b256eb12a4bc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231115627620409b9141238bf3b256eb12a4bc 2023-11-15 19:55:28,284 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311158d581c600bef454881ede2f6a41f28ae to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311158d581c600bef454881ede2f6a41f28ae 2023-11-15 19:55:28,689 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/3844b07336c84fc482e8437336187af6 2023-11-15 19:55:28,691 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/80ca5f3d31144ed0ac9c9973a515e273 2023-11-15 19:55:28,703 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311150f524df242cc40c59fe8a3dc13577a61 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311150f524df242cc40c59fe8a3dc13577a61 2023-11-15 19:55:28,704 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115ebf0f11ee3dd4703ad9635e0f1207cc0 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231115ebf0f11ee3dd4703ad9635e0f1207cc0 2023-11-15 19:55:29,109 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/75d00b2f100b4a9d934d78a1c457974c 2023-11-15 19:55:29,109 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/cbc36b0d49bb4a07b4f88f04645d5fc8 2023-11-15 19:55:29,114 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/80ca5f3d31144ed0ac9c9973a515e273 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/80ca5f3d31144ed0ac9c9973a515e273 2023-11-15 19:55:29,114 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/3844b07336c84fc482e8437336187af6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/3844b07336c84fc482e8437336187af6 2023-11-15 19:55:29,117 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/3844b07336c84fc482e8437336187af6, entries=4, sequenceid=5, filesize=5.4 K 2023-11-15 19:55:29,118 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/80ca5f3d31144ed0ac9c9973a515e273, entries=4, sequenceid=5, filesize=5.4 K 2023-11-15 19:55:29,118 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/75d00b2f100b4a9d934d78a1c457974c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/75d00b2f100b4a9d934d78a1c457974c 2023-11-15 19:55:29,119 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/cbc36b0d49bb4a07b4f88f04645d5fc8 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/cbc36b0d49bb4a07b4f88f04645d5fc8 2023-11-15 19:55:29,122 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/75d00b2f100b4a9d934d78a1c457974c, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:29,122 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/cbc36b0d49bb4a07b4f88f04645d5fc8, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:29,122 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for adece068f30ad1573248e55d1a9945a5 in 1254ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:29,122 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3e25eb704f1ec32bbf32935b51161078 in 1254ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:29,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:29,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:29,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:29,123 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:29,123 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:29,124 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:29,124 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:29,124 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,124 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-15 19:55:29,124 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-15 19:55:29,126 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,126 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:29,126 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,126 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:29,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-15 19:55:29,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58392a33[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:29,128 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-15 19:55:29,128 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,129 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,129 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-15 19:55:29,129 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-15 19:55:29,129 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:29,129 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,129 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:29,131 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,131 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-15 19:55:29,131 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:29,131 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-15 19:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:29,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:29,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:29,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:29,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:29,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-15 19:55:29,133 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-15 19:55:29,133 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:29,133 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:29,133 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-15 19:55:29,133 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:29,140 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,140 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,140 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:29,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,140 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:29,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:29,141 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,143 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,143 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:29,143 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:29,143 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:29,143 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-15 19:55:29,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:29,144 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:29,144 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:29,144 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:29,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-15 19:55:29,144 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:29,144 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:29,144 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:29,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:29,144 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:29,244 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:29,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:29,246 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:29,246 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:29,246 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:29,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:29,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:29,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-15 19:55:29,250 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-15 19:55:29,250 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:29,250 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-15 19:55:29,250 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-15 19:55:29,251 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,251 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:29,252 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:29,252 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:29,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:29,252 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:29,252 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:29,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:29,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:29,254 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-15 19:55:29,254 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-15 19:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-15 19:55:29,254 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-15 19:55:29,254 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:29,254 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-15 19:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. started... 2023-11-15 19:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. started... 2023-11-15 19:55:29,258 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5e9fedf55069b3b4497e68f08fb45546 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:29,258 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:29,259 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:29,258 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3e25eb704f1ec32bbf32935b51161078 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. started... 2023-11-15 19:55:29,259 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing adece068f30ad1573248e55d1a9945a5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:29,283 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111512165f5cf6754af79e6793db336a11c4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111512165f5cf6754af79e6793db336a11c4 2023-11-15 19:55:29,679 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111527a5b0ca60934aa5b36285a1df92c5bc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111527a5b0ca60934aa5b36285a1df92c5bc 2023-11-15 19:55:29,679 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115c7d760f39c874f78b422d28d37527f29 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231115c7d760f39c874f78b422d28d37527f29 2023-11-15 19:55:29,685 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/65e0966408e4480792e1cd29c2490ef7 2023-11-15 19:55:29,685 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/d006d861ada94959bf689bff34a91074 2023-11-15 19:55:29,690 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/d78401bdea4a4d248b3a949552acacda 2023-11-15 19:55:29,708 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311152d25b7b5f5b849378b8c868ec94fb533 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311152d25b7b5f5b849378b8c868ec94fb533 2023-11-15 19:55:29,709 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115a48ce7a0895c45e692642a0cd401aa20 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231115a48ce7a0895c45e692642a0cd401aa20 2023-11-15 19:55:30,119 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115db628cb6727748d28d256785458d7e68 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231115db628cb6727748d28d256785458d7e68 2023-11-15 19:55:30,120 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/04fbe29c37f64cb8b9681f2a585e9ae5 2023-11-15 19:55:30,121 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/2237f5ec3760498db8bd14ebd47c6a63 2023-11-15 19:55:30,125 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/65e0966408e4480792e1cd29c2490ef7 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/65e0966408e4480792e1cd29c2490ef7 2023-11-15 19:55:30,126 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/d006d861ada94959bf689bff34a91074 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/d006d861ada94959bf689bff34a91074 2023-11-15 19:55:30,129 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/d006d861ada94959bf689bff34a91074, entries=4, sequenceid=9, filesize=5.4 K 2023-11-15 19:55:30,130 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/65e0966408e4480792e1cd29c2490ef7, entries=4, sequenceid=9, filesize=5.4 K 2023-11-15 19:55:30,130 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/2237f5ec3760498db8bd14ebd47c6a63 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/2237f5ec3760498db8bd14ebd47c6a63 2023-11-15 19:55:30,130 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/04fbe29c37f64cb8b9681f2a585e9ae5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/04fbe29c37f64cb8b9681f2a585e9ae5 2023-11-15 19:55:30,134 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/2237f5ec3760498db8bd14ebd47c6a63, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:30,134 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/04fbe29c37f64cb8b9681f2a585e9ae5, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:30,135 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3e25eb704f1ec32bbf32935b51161078 in 877ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:30,135 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5e9fedf55069b3b4497e68f08fb45546 in 877ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:30,135 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:30,135 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:30,135 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:30,135 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:30,135 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:30,135 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:30,524 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/647eb6d771194b92ac1394531f7e590c 2023-11-15 19:55:30,528 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/d78401bdea4a4d248b3a949552acacda as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/d78401bdea4a4d248b3a949552acacda 2023-11-15 19:55:30,532 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/d78401bdea4a4d248b3a949552acacda, entries=4, sequenceid=9, filesize=5.4 K 2023-11-15 19:55:30,532 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/647eb6d771194b92ac1394531f7e590c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/647eb6d771194b92ac1394531f7e590c 2023-11-15 19:55:30,536 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/647eb6d771194b92ac1394531f7e590c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:30,536 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for adece068f30ad1573248e55d1a9945a5 in 1277ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:30,537 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:30,537 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:30,537 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:30,537 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:30,537 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,537 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-15 19:55:30,537 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-15 19:55:30,539 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,539 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:30,539 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,539 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:30,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-15 19:55:30,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f7f5e3[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:30,540 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-15 19:55:30,540 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,542 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,542 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-15 19:55:30,542 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-15 19:55:30,542 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:30,542 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,542 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:30,543 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-15 19:55:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:30,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:30,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-15 19:55:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:30,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-15 19:55:30,546 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-15 19:55:30,546 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:30,546 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:30,546 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-15 19:55:30,546 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:30,548 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,548 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:30,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:30,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,548 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:30,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:30,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:30,549 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:30,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:30,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,550 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,552 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,552 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:30,552 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:30,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:30,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-15 19:55:30,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:30,552 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:30,552 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:30,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:30,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:30,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,553 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:30,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:30,553 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:30,653 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:30,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:30,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:30,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:30,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:30,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:30,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-15 19:55:30,659 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-15 19:55:30,659 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:30,659 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-15 19:55:30,659 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-15 19:55:30,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,660 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:30,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,661 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:30,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:30,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:30,661 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:30,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:30,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:30,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:30,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-15 19:55:30,662 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-15 19:55:30,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-15 19:55:30,662 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-15 19:55:30,662 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:30,662 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-15 19:55:30,665 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:30,665 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. started... 2023-11-15 19:55:30,665 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3e25eb704f1ec32bbf32935b51161078 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:30,667 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:30,667 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:30,667 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:30,667 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:30,667 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. started... 2023-11-15 19:55:30,667 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. started... 2023-11-15 19:55:30,667 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing adece068f30ad1573248e55d1a9945a5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:30,668 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5e9fedf55069b3b4497e68f08fb45546 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:30,687 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115b83b6f0ee12d4a2eb9cbf4d2b697d886 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231115b83b6f0ee12d4a2eb9cbf4d2b697d886 2023-11-15 19:55:30,688 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311151100c038803d4ea2abce5a1ee465776f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311151100c038803d4ea2abce5a1ee465776f 2023-11-15 19:55:30,688 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311158198b3aeda674633b193658c69dadf7b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311158198b3aeda674633b193658c69dadf7b 2023-11-15 19:55:30,692 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/914eb947dc054887a3903f6a69c4c21e 2023-11-15 19:55:30,693 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/3027d21d3de540ecaf624cd2a6af10c6 2023-11-15 19:55:30,694 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/0e970e179d8642dc9831f8d2d2a5facf 2023-11-15 19:55:30,716 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115b287e608911048459d7424e93d24b299 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231115b287e608911048459d7424e93d24b299 2023-11-15 19:55:30,720 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311153f33a34d1802423f885a39a9780ca14d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311153f33a34d1802423f885a39a9780ca14d 2023-11-15 19:55:31,127 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/4e84f08bda9b4300869f6c9101b60bbd 2023-11-15 19:55:31,130 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311155c197e477e3344dbb64fb09f219c1d5d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311155c197e477e3344dbb64fb09f219c1d5d 2023-11-15 19:55:31,130 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/b240ed6286e24e85b05bfe3c57dccec9 2023-11-15 19:55:31,131 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/914eb947dc054887a3903f6a69c4c21e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/914eb947dc054887a3903f6a69c4c21e 2023-11-15 19:55:31,134 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/3027d21d3de540ecaf624cd2a6af10c6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/3027d21d3de540ecaf624cd2a6af10c6 2023-11-15 19:55:31,135 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/914eb947dc054887a3903f6a69c4c21e, entries=4, sequenceid=13, filesize=5.4 K 2023-11-15 19:55:31,136 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/4e84f08bda9b4300869f6c9101b60bbd as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/4e84f08bda9b4300869f6c9101b60bbd 2023-11-15 19:55:31,138 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/3027d21d3de540ecaf624cd2a6af10c6, entries=4, sequenceid=13, filesize=5.4 K 2023-11-15 19:55:31,139 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/b240ed6286e24e85b05bfe3c57dccec9 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/b240ed6286e24e85b05bfe3c57dccec9 2023-11-15 19:55:31,139 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/4e84f08bda9b4300869f6c9101b60bbd, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:31,140 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3e25eb704f1ec32bbf32935b51161078 in 475ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:31,141 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:31,141 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:31,141 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:31,144 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/b240ed6286e24e85b05bfe3c57dccec9, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:31,145 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5e9fedf55069b3b4497e68f08fb45546 in 477ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:31,145 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:31,145 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:31,145 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:31,536 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/0899589157b54919adaadf3f934da324 2023-11-15 19:55:31,540 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/0e970e179d8642dc9831f8d2d2a5facf as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0e970e179d8642dc9831f8d2d2a5facf 2023-11-15 19:55:31,543 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0e970e179d8642dc9831f8d2d2a5facf, entries=4, sequenceid=13, filesize=5.4 K 2023-11-15 19:55:31,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/0899589157b54919adaadf3f934da324 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/0899589157b54919adaadf3f934da324 2023-11-15 19:55:31,547 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/0899589157b54919adaadf3f934da324, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:31,548 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for adece068f30ad1573248e55d1a9945a5 in 881ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:31,548 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:31,548 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-15 19:55:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-15 19:55:31,550 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,550 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:31,550 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,550 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:31,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-15 19:55:31,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48a7e2a0[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:31,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-15 19:55:31,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,554 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-15 19:55:31,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-15 19:55:31,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:31,554 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,554 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-15 19:55:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:31,555 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-15 19:55:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-15 19:55:31,557 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-15 19:55:31,558 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:31,558 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:31,558 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-15 19:55:31,558 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:31,561 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,561 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:31,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,562 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:31,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:31,563 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:31,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:31,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,566 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,566 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:31,566 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:31,566 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:31,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:31,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-15 19:55:31,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:31,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-15 19:55:31,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:31,566 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,566 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:31,566 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:31,567 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,567 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:31,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:31,567 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:31,567 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:31,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:31,567 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,667 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:31,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:31,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:31,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:31,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:31,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:31,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:31,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-15 19:55:31,673 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-15 19:55:31,673 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:31,673 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-15 19:55:31,673 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-15 19:55:31,673 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,674 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:31,675 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:31,675 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:31,675 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:31,675 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:31,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:31,676 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-15 19:55:31,676 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-15 19:55:31,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-15 19:55:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-15 19:55:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-15 19:55:31,677 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:31,677 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:31,677 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:31,677 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:31,677 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. started... 2023-11-15 19:55:31,677 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. started... 2023-11-15 19:55:31,677 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:31,677 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. started... 2023-11-15 19:55:31,677 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5e9fedf55069b3b4497e68f08fb45546 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:31,677 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3e25eb704f1ec32bbf32935b51161078 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:31,677 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing adece068f30ad1573248e55d1a9945a5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:31,690 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311155829f08aa2224589aef444750e82106f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311155829f08aa2224589aef444750e82106f 2023-11-15 19:55:32,091 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115dae8e37ea5744868b2166cd8c9c62d77 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231115dae8e37ea5744868b2166cd8c9c62d77 2023-11-15 19:55:32,091 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111553d516cdc8d447b1a536e77a8fb5dbcb to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111553d516cdc8d447b1a536e77a8fb5dbcb 2023-11-15 19:55:32,095 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/36704f8efe7746739482f1b49efbcd6b 2023-11-15 19:55:32,096 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/cd93529693a34e3899194ad645036af3 2023-11-15 19:55:32,096 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/2470a058fda84ebbbc9c20e3a907f4ab 2023-11-15 19:55:32,108 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115942eeaa90148432b82104d476f4cadbc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231115942eeaa90148432b82104d476f4cadbc 2023-11-15 19:55:32,109 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111583852f23b19c4c7492fea2c451987f1f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023111583852f23b19c4c7492fea2c451987f1f 2023-11-15 19:55:32,113 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/9f24c2e242fb46a2ab87f3c0c11477a9 2023-11-15 19:55:32,116 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/2470a058fda84ebbbc9c20e3a907f4ab as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/2470a058fda84ebbbc9c20e3a907f4ab 2023-11-15 19:55:32,119 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/2470a058fda84ebbbc9c20e3a907f4ab, entries=4, sequenceid=17, filesize=5.4 K 2023-11-15 19:55:32,120 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/9f24c2e242fb46a2ab87f3c0c11477a9 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/9f24c2e242fb46a2ab87f3c0c11477a9 2023-11-15 19:55:32,123 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/9f24c2e242fb46a2ab87f3c0c11477a9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:32,124 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for adece068f30ad1573248e55d1a9945a5 in 447ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:32,124 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:32,124 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:32,124 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:32,397 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:55:32,509 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115ed7820f8fc0d46a5af5ec12ee1109dc9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231115ed7820f8fc0d46a5af5ec12ee1109dc9 2023-11-15 19:55:32,513 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/0f5b5ab680c74a658d59307c9b57501d 2023-11-15 19:55:32,516 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/cd93529693a34e3899194ad645036af3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/cd93529693a34e3899194ad645036af3 2023-11-15 19:55:32,520 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/cd93529693a34e3899194ad645036af3, entries=4, sequenceid=17, filesize=5.4 K 2023-11-15 19:55:32,520 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/0f5b5ab680c74a658d59307c9b57501d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/0f5b5ab680c74a658d59307c9b57501d 2023-11-15 19:55:32,523 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/0f5b5ab680c74a658d59307c9b57501d, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:32,524 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3e25eb704f1ec32bbf32935b51161078 in 847ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:32,524 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:32,524 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:32,914 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/93e1e75ff5fc4e329c98527d5361ce0f 2023-11-15 19:55:32,919 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/36704f8efe7746739482f1b49efbcd6b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/36704f8efe7746739482f1b49efbcd6b 2023-11-15 19:55:32,922 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/36704f8efe7746739482f1b49efbcd6b, entries=4, sequenceid=17, filesize=5.4 K 2023-11-15 19:55:32,923 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/93e1e75ff5fc4e329c98527d5361ce0f as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/93e1e75ff5fc4e329c98527d5361ce0f 2023-11-15 19:55:32,926 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/93e1e75ff5fc4e329c98527d5361ce0f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:32,927 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5e9fedf55069b3b4497e68f08fb45546 in 1250ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:32,927 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:32,927 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:32,927 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:32,927 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:32,927 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,927 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-15 19:55:32,927 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-15 19:55:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,929 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,930 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:32,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-15 19:55:32,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79958fc3[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:32,931 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-15 19:55:32,931 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,932 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,932 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-15 19:55:32,932 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-15 19:55:32,932 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:32,932 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,933 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:32,935 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,935 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-15 19:55:32,935 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:32,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:32,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:32,935 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-15 19:55:32,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:32,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:32,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:32,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:32,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:32,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:32,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-15 19:55:32,937 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-15 19:55:32,937 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:32,937 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:32,937 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-15 19:55:32,938 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:32,939 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:32,939 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:32,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:32,939 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:32,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:32,940 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:32,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:32,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:32,941 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:32,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:32,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-15 19:55:32,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:32,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-15 19:55:32,944 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:32,944 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:32,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:33,044 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:33,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:33,053 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:33,061 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:33,069 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:33,070 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:33,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:33,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:33,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-15 19:55:33,100 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-15 19:55:33,101 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:33,101 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-15 19:55:33,101 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-15 19:55:33,101 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:33,101 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:33,102 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:33,103 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:33,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:33,103 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:33,103 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:33,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:33,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-15 19:55:33,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-15 19:55:33,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-15 19:55:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-15 19:55:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-15 19:55:33,104 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:33,104 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. started... 2023-11-15 19:55:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:33,104 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3e25eb704f1ec32bbf32935b51161078 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:33,104 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:33,104 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. started... 2023-11-15 19:55:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:33,104 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:33,104 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5e9fedf55069b3b4497e68f08fb45546 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:33,105 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. started... 2023-11-15 19:55:33,105 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing adece068f30ad1573248e55d1a9945a5 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:33,520 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/e6567da3b3ff4757b5dbbe1d8cc523eb 2023-11-15 19:55:33,524 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6567da3b3ff4757b5dbbe1d8cc523eb 2023-11-15 19:55:33,921 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/721a58636df8417fa3a05b7b0a272072 2023-11-15 19:55:33,922 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/0f22ae74601f4cf9a84d390eb780d688 2023-11-15 19:55:33,925 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 721a58636df8417fa3a05b7b0a272072 2023-11-15 19:55:33,925 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f22ae74601f4cf9a84d390eb780d688 2023-11-15 19:55:33,938 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/335c6d11d30d4e2fa3a7691b672f466f 2023-11-15 19:55:33,941 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 335c6d11d30d4e2fa3a7691b672f466f 2023-11-15 19:55:33,941 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/e6567da3b3ff4757b5dbbe1d8cc523eb as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/e6567da3b3ff4757b5dbbe1d8cc523eb 2023-11-15 19:55:33,945 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6567da3b3ff4757b5dbbe1d8cc523eb 2023-11-15 19:55:33,945 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/e6567da3b3ff4757b5dbbe1d8cc523eb, entries=3, sequenceid=23, filesize=5.0 K 2023-11-15 19:55:33,945 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/335c6d11d30d4e2fa3a7691b672f466f as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/335c6d11d30d4e2fa3a7691b672f466f 2023-11-15 19:55:33,948 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 335c6d11d30d4e2fa3a7691b672f466f 2023-11-15 19:55:33,948 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/335c6d11d30d4e2fa3a7691b672f466f, entries=1, sequenceid=23, filesize=5.0 K 2023-11-15 19:55:33,949 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5e9fedf55069b3b4497e68f08fb45546 in 845ms, sequenceid=23, compaction requested=true 2023-11-15 19:55:33,949 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:33,949 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:33,949 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:34,737 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/b622db999f2846b1975abc1db0e664e9 2023-11-15 19:55:34,738 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/1385a1673fdc4d82a8b58becbd3cda8a 2023-11-15 19:55:34,741 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1385a1673fdc4d82a8b58becbd3cda8a 2023-11-15 19:55:34,742 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/0f22ae74601f4cf9a84d390eb780d688 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0f22ae74601f4cf9a84d390eb780d688 2023-11-15 19:55:34,743 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b622db999f2846b1975abc1db0e664e9 2023-11-15 19:55:34,744 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/721a58636df8417fa3a05b7b0a272072 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/721a58636df8417fa3a05b7b0a272072 2023-11-15 19:55:34,746 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f22ae74601f4cf9a84d390eb780d688 2023-11-15 19:55:34,746 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0f22ae74601f4cf9a84d390eb780d688, entries=3, sequenceid=23, filesize=5.0 K 2023-11-15 19:55:34,748 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/1385a1673fdc4d82a8b58becbd3cda8a as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/1385a1673fdc4d82a8b58becbd3cda8a 2023-11-15 19:55:34,749 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 721a58636df8417fa3a05b7b0a272072 2023-11-15 19:55:34,749 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/721a58636df8417fa3a05b7b0a272072, entries=3, sequenceid=23, filesize=5.0 K 2023-11-15 19:55:34,750 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/b622db999f2846b1975abc1db0e664e9 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/b622db999f2846b1975abc1db0e664e9 2023-11-15 19:55:34,751 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1385a1673fdc4d82a8b58becbd3cda8a 2023-11-15 19:55:34,751 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/1385a1673fdc4d82a8b58becbd3cda8a, entries=1, sequenceid=23, filesize=5.0 K 2023-11-15 19:55:34,752 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for adece068f30ad1573248e55d1a9945a5 in 1647ms, sequenceid=23, compaction requested=true 2023-11-15 19:55:34,752 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:34,752 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:34,752 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:34,753 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b622db999f2846b1975abc1db0e664e9 2023-11-15 19:55:34,754 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/b622db999f2846b1975abc1db0e664e9, entries=1, sequenceid=23, filesize=5.0 K 2023-11-15 19:55:34,754 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3e25eb704f1ec32bbf32935b51161078 in 1650ms, sequenceid=23, compaction requested=true 2023-11-15 19:55:34,754 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:34,754 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:34,754 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:34,754 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:34,754 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,755 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-15 19:55:34,755 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-15 19:55:34,757 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,757 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:34,758 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,758 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:34,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-15 19:55:34,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@686c5a70[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:34,759 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-15 19:55:34,759 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,760 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,761 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-15 19:55:34,761 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-15 19:55:34,761 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:34,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:34,762 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-15 19:55:34,762 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:34,762 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,762 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-15 19:55:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:34,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-15 19:55:34,764 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-15 19:55:34,764 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:34,764 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:34,764 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-15 19:55:34,764 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:34,766 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:34,766 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:34,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:34,766 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:34,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:34,767 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,768 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-15 19:55:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:34,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-15 19:55:34,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-15 19:55:34,771 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:34,771 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-15 19:55:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:34,772 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:34,772 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:34,872 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:34,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:34,873 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:34,873 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 3e25eb704f1ec32bbf32935b51161078/family1 is initiating major compaction (all files) 2023-11-15 19:55:34,873 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:34,873 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:34,873 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 3e25eb704f1ec32bbf32935b51161078/family1 in ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:34,873 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/80ca5f3d31144ed0ac9c9973a515e273, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/d006d861ada94959bf689bff34a91074, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/914eb947dc054887a3903f6a69c4c21e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/cd93529693a34e3899194ad645036af3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/721a58636df8417fa3a05b7b0a272072] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp, totalSize=26.6 K 2023-11-15 19:55:34,874 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 80ca5f3d31144ed0ac9c9973a515e273, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078127858 2023-11-15 19:55:34,874 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting d006d861ada94959bf689bff34a91074, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078129246 2023-11-15 19:55:34,875 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 914eb947dc054887a3903f6a69c4c21e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078130655 2023-11-15 19:55:34,875 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting cd93529693a34e3899194ad645036af3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078131669 2023-11-15 19:55:34,876 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 721a58636df8417fa3a05b7b0a272072, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:55:34,885 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 3e25eb704f1ec32bbf32935b51161078#family1#compaction#149 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:35,292 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231115a44466ba0a4e42f0b8065174c7f29dd5_del 2023-11-15 19:55:35,293 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115a44466ba0a4e42f0b8065174c7f29dd5_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231115a44466ba0a4e42f0b8065174c7f29dd5_del 2023-11-15 19:55:36,106 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae8694d1ba144cdab58439305e0f9e1e 2023-11-15 19:55:36,107 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family1/ae8694d1ba144cdab58439305e0f9e1e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/ae8694d1ba144cdab58439305e0f9e1e 2023-11-15 19:55:36,111 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae8694d1ba144cdab58439305e0f9e1e 2023-11-15 19:55:36,112 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3e25eb704f1ec32bbf32935b51161078/family1 of 3e25eb704f1ec32bbf32935b51161078 into ae8694d1ba144cdab58439305e0f9e1e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:36,112 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:36,112 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:36,112 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 3e25eb704f1ec32bbf32935b51161078/family2 is initiating major compaction (all files) 2023-11-15 19:55:36,113 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:36,113 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:36,113 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 3e25eb704f1ec32bbf32935b51161078/family2 in ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:55:36,113 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/cbc36b0d49bb4a07b4f88f04645d5fc8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/2237f5ec3760498db8bd14ebd47c6a63, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/4e84f08bda9b4300869f6c9101b60bbd, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/0f5b5ab680c74a658d59307c9b57501d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/b622db999f2846b1975abc1db0e664e9] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp, totalSize=25.3 K 2023-11-15 19:55:36,114 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting cbc36b0d49bb4a07b4f88f04645d5fc8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078127858 2023-11-15 19:55:36,114 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 2237f5ec3760498db8bd14ebd47c6a63, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078129246 2023-11-15 19:55:36,115 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 4e84f08bda9b4300869f6c9101b60bbd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078130655 2023-11-15 19:55:36,115 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 0f5b5ab680c74a658d59307c9b57501d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078131669 2023-11-15 19:55:36,115 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting b622db999f2846b1975abc1db0e664e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:55:36,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/80ca5f3d31144ed0ac9c9973a515e273, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/d006d861ada94959bf689bff34a91074, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/914eb947dc054887a3903f6a69c4c21e, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/cd93529693a34e3899194ad645036af3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/721a58636df8417fa3a05b7b0a272072] to archive 2023-11-15 19:55:36,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:36,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/80ca5f3d31144ed0ac9c9973a515e273 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/80ca5f3d31144ed0ac9c9973a515e273 2023-11-15 19:55:36,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/d006d861ada94959bf689bff34a91074 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/d006d861ada94959bf689bff34a91074 2023-11-15 19:55:36,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/914eb947dc054887a3903f6a69c4c21e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/914eb947dc054887a3903f6a69c4c21e 2023-11-15 19:55:36,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/cd93529693a34e3899194ad645036af3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/cd93529693a34e3899194ad645036af3 2023-11-15 19:55:36,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/721a58636df8417fa3a05b7b0a272072 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/721a58636df8417fa3a05b7b0a272072 2023-11-15 19:55:36,125 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 3e25eb704f1ec32bbf32935b51161078#family2#compaction#150 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:36,533 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231115cc813ece0621454496f15ad44e383de3_del 2023-11-15 19:55:36,533 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115cc813ece0621454496f15ad44e383de3_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231115cc813ece0621454496f15ad44e383de3_del 2023-11-15 19:55:37,346 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daa28cedeec341cc890118849a03d51e 2023-11-15 19:55:37,347 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/.tmp/family2/daa28cedeec341cc890118849a03d51e as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/daa28cedeec341cc890118849a03d51e 2023-11-15 19:55:37,350 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for daa28cedeec341cc890118849a03d51e 2023-11-15 19:55:37,351 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3e25eb704f1ec32bbf32935b51161078/family2 of 3e25eb704f1ec32bbf32935b51161078 into daa28cedeec341cc890118849a03d51e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:37,351 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:37,351 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:37,351 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): adece068f30ad1573248e55d1a9945a5/family1 is initiating major compaction (all files) 2023-11-15 19:55:37,351 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:37,351 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:37,351 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of adece068f30ad1573248e55d1a9945a5/family1 in ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:37,352 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/3844b07336c84fc482e8437336187af6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/d78401bdea4a4d248b3a949552acacda, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0e970e179d8642dc9831f8d2d2a5facf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/2470a058fda84ebbbc9c20e3a907f4ab, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0f22ae74601f4cf9a84d390eb780d688] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp, totalSize=26.6 K 2023-11-15 19:55:37,352 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 3844b07336c84fc482e8437336187af6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078127858 2023-11-15 19:55:37,352 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting d78401bdea4a4d248b3a949552acacda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078129246 2023-11-15 19:55:37,353 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 0e970e179d8642dc9831f8d2d2a5facf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078130655 2023-11-15 19:55:37,353 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 2470a058fda84ebbbc9c20e3a907f4ab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078131669 2023-11-15 19:55:37,353 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 0f22ae74601f4cf9a84d390eb780d688, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:55:37,361 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): adece068f30ad1573248e55d1a9945a5#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:37,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/cbc36b0d49bb4a07b4f88f04645d5fc8, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/2237f5ec3760498db8bd14ebd47c6a63, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/4e84f08bda9b4300869f6c9101b60bbd, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/0f5b5ab680c74a658d59307c9b57501d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/b622db999f2846b1975abc1db0e664e9] to archive 2023-11-15 19:55:37,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:37,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/cbc36b0d49bb4a07b4f88f04645d5fc8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/cbc36b0d49bb4a07b4f88f04645d5fc8 2023-11-15 19:55:37,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/2237f5ec3760498db8bd14ebd47c6a63 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/2237f5ec3760498db8bd14ebd47c6a63 2023-11-15 19:55:37,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/4e84f08bda9b4300869f6c9101b60bbd to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/4e84f08bda9b4300869f6c9101b60bbd 2023-11-15 19:55:37,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/0f5b5ab680c74a658d59307c9b57501d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/0f5b5ab680c74a658d59307c9b57501d 2023-11-15 19:55:37,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/b622db999f2846b1975abc1db0e664e9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family2/b622db999f2846b1975abc1db0e664e9 2023-11-15 19:55:37,769 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311153bc6b459147a4cfb8ea69d6a6cfefb64_del 2023-11-15 19:55:37,769 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311153bc6b459147a4cfb8ea69d6a6cfefb64_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311153bc6b459147a4cfb8ea69d6a6cfefb64_del 2023-11-15 19:55:38,582 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df3b4fafc09644fba00530715b6d585f 2023-11-15 19:55:38,582 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family1/df3b4fafc09644fba00530715b6d585f as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/df3b4fafc09644fba00530715b6d585f 2023-11-15 19:55:38,586 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df3b4fafc09644fba00530715b6d585f 2023-11-15 19:55:38,587 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in adece068f30ad1573248e55d1a9945a5/family1 of adece068f30ad1573248e55d1a9945a5 into df3b4fafc09644fba00530715b6d585f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:38,587 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:38,587 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:38,587 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): adece068f30ad1573248e55d1a9945a5/family2 is initiating major compaction (all files) 2023-11-15 19:55:38,587 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:38,587 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:38,588 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of adece068f30ad1573248e55d1a9945a5/family2 in ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:55:38,588 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/75d00b2f100b4a9d934d78a1c457974c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/647eb6d771194b92ac1394531f7e590c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/0899589157b54919adaadf3f934da324, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/9f24c2e242fb46a2ab87f3c0c11477a9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/1385a1673fdc4d82a8b58becbd3cda8a] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp, totalSize=25.3 K 2023-11-15 19:55:38,589 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 75d00b2f100b4a9d934d78a1c457974c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078127858 2023-11-15 19:55:38,589 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 647eb6d771194b92ac1394531f7e590c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078129246 2023-11-15 19:55:38,590 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 0899589157b54919adaadf3f934da324, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078130655 2023-11-15 19:55:38,590 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 9f24c2e242fb46a2ab87f3c0c11477a9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078131669 2023-11-15 19:55:38,590 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 1385a1673fdc4d82a8b58becbd3cda8a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:55:38,598 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): adece068f30ad1573248e55d1a9945a5#family2#compaction#152 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:38,605 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311157d7c717df06b40b69ad13d9e48e26e59_del 2023-11-15 19:55:38,605 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311157d7c717df06b40b69ad13d9e48e26e59_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311157d7c717df06b40b69ad13d9e48e26e59_del 2023-11-15 19:55:38,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/3844b07336c84fc482e8437336187af6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/d78401bdea4a4d248b3a949552acacda, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0e970e179d8642dc9831f8d2d2a5facf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/2470a058fda84ebbbc9c20e3a907f4ab, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0f22ae74601f4cf9a84d390eb780d688] to archive 2023-11-15 19:55:38,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:38,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/3844b07336c84fc482e8437336187af6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/3844b07336c84fc482e8437336187af6 2023-11-15 19:55:38,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/d78401bdea4a4d248b3a949552acacda to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/d78401bdea4a4d248b3a949552acacda 2023-11-15 19:55:38,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0e970e179d8642dc9831f8d2d2a5facf to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0e970e179d8642dc9831f8d2d2a5facf 2023-11-15 19:55:38,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/2470a058fda84ebbbc9c20e3a907f4ab to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/2470a058fda84ebbbc9c20e3a907f4ab 2023-11-15 19:55:38,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0f22ae74601f4cf9a84d390eb780d688 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/0f22ae74601f4cf9a84d390eb780d688 2023-11-15 19:55:39,420 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67d22b8e67f74b72bc97b6e69c51a633 2023-11-15 19:55:39,421 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/.tmp/family2/67d22b8e67f74b72bc97b6e69c51a633 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/67d22b8e67f74b72bc97b6e69c51a633 2023-11-15 19:55:39,425 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67d22b8e67f74b72bc97b6e69c51a633 2023-11-15 19:55:39,426 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in adece068f30ad1573248e55d1a9945a5/family2 of adece068f30ad1573248e55d1a9945a5 into 67d22b8e67f74b72bc97b6e69c51a633(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:55:39,426 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:39,426 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:39,426 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 5e9fedf55069b3b4497e68f08fb45546/family1 is initiating major compaction (all files) 2023-11-15 19:55:39,426 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:39,426 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:39,427 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 5e9fedf55069b3b4497e68f08fb45546/family1 in ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:39,427 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/97ecc5450ff94f4fb91bf92e1739a314, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/65e0966408e4480792e1cd29c2490ef7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/3027d21d3de540ecaf624cd2a6af10c6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/36704f8efe7746739482f1b49efbcd6b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/e6567da3b3ff4757b5dbbe1d8cc523eb] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp, totalSize=26.6 K 2023-11-15 19:55:39,427 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 97ecc5450ff94f4fb91bf92e1739a314, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078127857 2023-11-15 19:55:39,428 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 65e0966408e4480792e1cd29c2490ef7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078129246 2023-11-15 19:55:39,428 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 3027d21d3de540ecaf624cd2a6af10c6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078130655 2023-11-15 19:55:39,428 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 36704f8efe7746739482f1b49efbcd6b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078131669 2023-11-15 19:55:39,429 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting e6567da3b3ff4757b5dbbe1d8cc523eb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:55:39,437 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 5e9fedf55069b3b4497e68f08fb45546#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:39,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/75d00b2f100b4a9d934d78a1c457974c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/647eb6d771194b92ac1394531f7e590c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/0899589157b54919adaadf3f934da324, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/9f24c2e242fb46a2ab87f3c0c11477a9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/1385a1673fdc4d82a8b58becbd3cda8a] to archive 2023-11-15 19:55:39,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:39,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/75d00b2f100b4a9d934d78a1c457974c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/75d00b2f100b4a9d934d78a1c457974c 2023-11-15 19:55:39,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/647eb6d771194b92ac1394531f7e590c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/647eb6d771194b92ac1394531f7e590c 2023-11-15 19:55:39,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/0899589157b54919adaadf3f934da324 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/0899589157b54919adaadf3f934da324 2023-11-15 19:55:39,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/9f24c2e242fb46a2ab87f3c0c11477a9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/9f24c2e242fb46a2ab87f3c0c11477a9 2023-11-15 19:55:39,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/1385a1673fdc4d82a8b58becbd3cda8a to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family2/1385a1673fdc4d82a8b58becbd3cda8a 2023-11-15 19:55:39,844 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231115606c4b6f6b7c413d9dfe0274610c2dfd_del 2023-11-15 19:55:39,845 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115606c4b6f6b7c413d9dfe0274610c2dfd_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231115606c4b6f6b7c413d9dfe0274610c2dfd_del 2023-11-15 19:55:40,658 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15577a66c07c418584ed894f368e0971 2023-11-15 19:55:40,659 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family1/15577a66c07c418584ed894f368e0971 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/15577a66c07c418584ed894f368e0971 2023-11-15 19:55:40,663 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15577a66c07c418584ed894f368e0971 2023-11-15 19:55:40,664 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5e9fedf55069b3b4497e68f08fb45546/family1 of 5e9fedf55069b3b4497e68f08fb45546 into 15577a66c07c418584ed894f368e0971(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:40,664 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:40,664 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:55:40,664 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 5e9fedf55069b3b4497e68f08fb45546/family2 is initiating major compaction (all files) 2023-11-15 19:55:40,664 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:55:40,664 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:55:40,664 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 5e9fedf55069b3b4497e68f08fb45546/family2 in ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:55:40,665 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/0d3101e14c6f4e84a7702a916fe99b89, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/04fbe29c37f64cb8b9681f2a585e9ae5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/b240ed6286e24e85b05bfe3c57dccec9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/93e1e75ff5fc4e329c98527d5361ce0f, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/335c6d11d30d4e2fa3a7691b672f466f] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp, totalSize=25.3 K 2023-11-15 19:55:40,665 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 0d3101e14c6f4e84a7702a916fe99b89, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078127857 2023-11-15 19:55:40,665 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 04fbe29c37f64cb8b9681f2a585e9ae5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078129246 2023-11-15 19:55:40,666 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting b240ed6286e24e85b05bfe3c57dccec9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078130655 2023-11-15 19:55:40,666 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 93e1e75ff5fc4e329c98527d5361ce0f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078131669 2023-11-15 19:55:40,667 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 335c6d11d30d4e2fa3a7691b672f466f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:55:40,675 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 5e9fedf55069b3b4497e68f08fb45546#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:40,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/97ecc5450ff94f4fb91bf92e1739a314, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/65e0966408e4480792e1cd29c2490ef7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/3027d21d3de540ecaf624cd2a6af10c6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/36704f8efe7746739482f1b49efbcd6b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/e6567da3b3ff4757b5dbbe1d8cc523eb] to archive 2023-11-15 19:55:40,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:40,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/97ecc5450ff94f4fb91bf92e1739a314 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/97ecc5450ff94f4fb91bf92e1739a314 2023-11-15 19:55:40,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/65e0966408e4480792e1cd29c2490ef7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/65e0966408e4480792e1cd29c2490ef7 2023-11-15 19:55:40,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/3027d21d3de540ecaf624cd2a6af10c6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/3027d21d3de540ecaf624cd2a6af10c6 2023-11-15 19:55:40,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/36704f8efe7746739482f1b49efbcd6b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/36704f8efe7746739482f1b49efbcd6b 2023-11-15 19:55:40,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/e6567da3b3ff4757b5dbbe1d8cc523eb to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/e6567da3b3ff4757b5dbbe1d8cc523eb 2023-11-15 19:55:41,083 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311154bc3536b6a5e403c8613aafaee562593_del 2023-11-15 19:55:41,083 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311154bc3536b6a5e403c8613aafaee562593_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311154bc3536b6a5e403c8613aafaee562593_del 2023-11-15 19:55:41,902 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 641e914281634ae7b77aa061dc5c3672 2023-11-15 19:55:41,902 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/.tmp/family2/641e914281634ae7b77aa061dc5c3672 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/641e914281634ae7b77aa061dc5c3672 2023-11-15 19:55:41,905 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 641e914281634ae7b77aa061dc5c3672 2023-11-15 19:55:41,906 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5e9fedf55069b3b4497e68f08fb45546/family2 of 5e9fedf55069b3b4497e68f08fb45546 into 641e914281634ae7b77aa061dc5c3672(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:55:41,906 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:41,909 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:41,912 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:41,915 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:41,916 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:41,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/0d3101e14c6f4e84a7702a916fe99b89, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/04fbe29c37f64cb8b9681f2a585e9ae5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/b240ed6286e24e85b05bfe3c57dccec9, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/93e1e75ff5fc4e329c98527d5361ce0f, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/335c6d11d30d4e2fa3a7691b672f466f] to archive 2023-11-15 19:55:41,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:41,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/0d3101e14c6f4e84a7702a916fe99b89 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/0d3101e14c6f4e84a7702a916fe99b89 2023-11-15 19:55:41,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/04fbe29c37f64cb8b9681f2a585e9ae5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/04fbe29c37f64cb8b9681f2a585e9ae5 2023-11-15 19:55:41,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/b240ed6286e24e85b05bfe3c57dccec9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/b240ed6286e24e85b05bfe3c57dccec9 2023-11-15 19:55:41,922 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-15 19:55:41,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/93e1e75ff5fc4e329c98527d5361ce0f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/93e1e75ff5fc4e329c98527d5361ce0f 2023-11-15 19:55:41,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/335c6d11d30d4e2fa3a7691b672f466f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family2/335c6d11d30d4e2fa3a7691b672f466f 2023-11-15 19:55:41,937 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-15 19:55:41,940 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231115606c4b6f6b7c413d9dfe0274610c2dfd_del 2023-11-15 19:55:41,943 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231115a44466ba0a4e42f0b8065174c7f29dd5_del 2023-11-15 19:55:41,946 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311153bc6b459147a4cfb8ea69d6a6cfefb64_del 2023-11-15 19:55:41,946 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:41,947 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(139): Connect 0x2366f760 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:55:41,952 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dd77f59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:55:41,953 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231115 for table='ns:testMinorCompaction' and column='family1' 2023-11-15 19:55:41,953 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231115 for table='ns:testMinorCompaction' and column='family1' 2023-11-15 19:55:41,953 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231115 for table='ns:testMinorCompaction' and column='family1' 2023-11-15 19:55:42,390 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311152da11f9af93448bda6f4731a67cbd179 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311152da11f9af93448bda6f4731a67cbd179 2023-11-15 19:55:42,391 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:42,410 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:55:42,413 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:55:42,420 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:55:42,423 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:55:42,434 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/family1/5746f0cc7a0144abafa423570e42cc95 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-15 19:55:42,435 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/family1/5746f0cc7a0144abafa423570e42cc95}] 2023-11-15 19:55:42,443 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/family1/5746f0cc7a0144abafa423570e42cc95 for inclusion in 5e9fedf55069b3b4497e68f08fb45546/family1 2023-11-15 19:55:42,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-15 19:55:42,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last=1 2023-11-15 19:55:42,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:55:42,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231115/family1/5746f0cc7a0144abafa423570e42cc95 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__2q006o7pdqa6dq93931uf6m55q8c5rqeqtvk3skborunto9nm65i81ctvcm6ebn1/family1/5746f0cc7a0144abafa423570e42cc95 2023-11-15 19:55:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__2q006o7pdqa6dq93931uf6m55q8c5rqeqtvk3skborunto9nm65i81ctvcm6ebn1/family1/5746f0cc7a0144abafa423570e42cc95 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/5dba04c9add64bf5aca69cf994171b8b_SeqId_28_ 2023-11-15 19:55:42,449 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__2q006o7pdqa6dq93931uf6m55q8c5rqeqtvk3skborunto9nm65i81ctvcm6ebn1/family1/5746f0cc7a0144abafa423570e42cc95 into 5e9fedf55069b3b4497e68f08fb45546/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/5dba04c9add64bf5aca69cf994171b8b_SeqId_28_ - updating store file list. 2023-11-15 19:55:42,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/5dba04c9add64bf5aca69cf994171b8b_SeqId_28_ into 5e9fedf55069b3b4497e68f08fb45546/family1 2023-11-15 19:55:42,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__2q006o7pdqa6dq93931uf6m55q8c5rqeqtvk3skborunto9nm65i81ctvcm6ebn1/family1/5746f0cc7a0144abafa423570e42cc95 into 5e9fedf55069b3b4497e68f08fb45546/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/family1/5dba04c9add64bf5aca69cf994171b8b_SeqId_28_) 2023-11-15 19:55:42,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__2q006o7pdqa6dq93931uf6m55q8c5rqeqtvk3skborunto9nm65i81ctvcm6ebn1/family1/5746f0cc7a0144abafa423570e42cc95 2023-11-15 19:55:42,454 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:42,455 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:42,456 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311159e820b50762743eab1f970822ac261d6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311159e820b50762743eab1f970822ac261d6 2023-11-15 19:55:42,456 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-15 19:55:42,456 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231115' 2023-11-15 19:55:42,457 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231115 for table='ns:testMinorCompaction' and column='family1' 2023-11-15 19:55:42,779 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115ed9968b3dcb7432d961ac46583f2b8b8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231115ed9968b3dcb7432d961ac46583f2b8b8 2023-11-15 19:55:42,779 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:42,794 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115e21dd28b39ef4b2abe959703930b0f14 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231115e21dd28b39ef4b2abe959703930b0f14 2023-11-15 19:55:42,794 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:42,807 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231115/family1/675bf40e0d92429bb940c524e56ad4c4 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-15 19:55:42,808 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231115/family1/675bf40e0d92429bb940c524e56ad4c4}] 2023-11-15 19:55:42,810 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231115/family1/675bf40e0d92429bb940c524e56ad4c4 for inclusion in 3e25eb704f1ec32bbf32935b51161078/family1 2023-11-15 19:55:42,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-15 19:55:42,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-15 19:55:42,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:55:42,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231115/family1/675bf40e0d92429bb940c524e56ad4c4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__o9mjcd8i8u59gte6hlovi8ja9rtfeepqn0i94ht3h5luiqc288evhq2t6rqukfkp/family1/675bf40e0d92429bb940c524e56ad4c4 2023-11-15 19:55:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__o9mjcd8i8u59gte6hlovi8ja9rtfeepqn0i94ht3h5luiqc288evhq2t6rqukfkp/family1/675bf40e0d92429bb940c524e56ad4c4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/712f3a36c314443a8ab393a68950d281_SeqId_28_ 2023-11-15 19:55:42,815 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__o9mjcd8i8u59gte6hlovi8ja9rtfeepqn0i94ht3h5luiqc288evhq2t6rqukfkp/family1/675bf40e0d92429bb940c524e56ad4c4 into 3e25eb704f1ec32bbf32935b51161078/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/712f3a36c314443a8ab393a68950d281_SeqId_28_ - updating store file list. 2023-11-15 19:55:42,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/712f3a36c314443a8ab393a68950d281_SeqId_28_ into 3e25eb704f1ec32bbf32935b51161078/family1 2023-11-15 19:55:42,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__o9mjcd8i8u59gte6hlovi8ja9rtfeepqn0i94ht3h5luiqc288evhq2t6rqukfkp/family1/675bf40e0d92429bb940c524e56ad4c4 into 3e25eb704f1ec32bbf32935b51161078/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/family1/712f3a36c314443a8ab393a68950d281_SeqId_28_) 2023-11-15 19:55:42,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__o9mjcd8i8u59gte6hlovi8ja9rtfeepqn0i94ht3h5luiqc288evhq2t6rqukfkp/family1/675bf40e0d92429bb940c524e56ad4c4 2023-11-15 19:55:42,824 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:42,826 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:42,827 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311158d581c600bef454881ede2f6a41f28ae to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311158d581c600bef454881ede2f6a41f28ae 2023-11-15 19:55:42,827 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-15 19:55:42,827 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231115' 2023-11-15 19:55:42,828 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231115 for table='ns:testMinorCompaction' and column='family1' 2023-11-15 19:55:42,828 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231115/family1/2b53fb581c71426286ac6d7543e2d188 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-15 19:55:42,828 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231115/family1/2b53fb581c71426286ac6d7543e2d188}] 2023-11-15 19:55:42,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231115/family1/2b53fb581c71426286ac6d7543e2d188 for inclusion in adece068f30ad1573248e55d1a9945a5/family1 2023-11-15 19:55:42,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-15 19:55:42,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-15 19:55:42,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:55:42,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231115/family1/2b53fb581c71426286ac6d7543e2d188 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__91c7i8mud3bmvn06sjcb4krjsknfag9bu04l3iv2s029n5k5ps1aj0liektgokuf/family1/2b53fb581c71426286ac6d7543e2d188 2023-11-15 19:55:42,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__91c7i8mud3bmvn06sjcb4krjsknfag9bu04l3iv2s029n5k5ps1aj0liektgokuf/family1/2b53fb581c71426286ac6d7543e2d188 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/abb96059bfe64b43911b76f58051414a_SeqId_28_ 2023-11-15 19:55:42,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__91c7i8mud3bmvn06sjcb4krjsknfag9bu04l3iv2s029n5k5ps1aj0liektgokuf/family1/2b53fb581c71426286ac6d7543e2d188 into adece068f30ad1573248e55d1a9945a5/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/abb96059bfe64b43911b76f58051414a_SeqId_28_ - updating store file list. 2023-11-15 19:55:42,840 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/abb96059bfe64b43911b76f58051414a_SeqId_28_ into adece068f30ad1573248e55d1a9945a5/family1 2023-11-15 19:55:42,840 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__91c7i8mud3bmvn06sjcb4krjsknfag9bu04l3iv2s029n5k5ps1aj0liektgokuf/family1/2b53fb581c71426286ac6d7543e2d188 into adece068f30ad1573248e55d1a9945a5/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/family1/abb96059bfe64b43911b76f58051414a_SeqId_28_) 2023-11-15 19:55:42,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__ns_testMinorCompaction__91c7i8mud3bmvn06sjcb4krjsknfag9bu04l3iv2s029n5k5ps1aj0liektgokuf/family1/2b53fb581c71426286ac6d7543e2d188 2023-11-15 19:55:42,842 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:42,842 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:42,844 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231115627620409b9141238bf3b256eb12a4bc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231115627620409b9141238bf3b256eb12a4bc 2023-11-15 19:55:42,844 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-15 19:55:42,844 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231115' 2023-11-15 19:55:42,844 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231115 for table='ns:testMinorCompaction' and column='family1' 2023-11-15 19:55:42,844 INFO [Listener at localhost/43577] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-15 19:55:42,846 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:42,848 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:42,851 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:42,852 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:42,873 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 290), OpenFileDescriptor=673 (was 796), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 156), ProcessCount=170 (was 172), AvailableMemoryMB=1246 (was 1130) - AvailableMemoryMB LEAK? - 2023-11-15 19:55:42,885 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=673, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=170, AvailableMemoryMB=1245 2023-11-15 19:55:42,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-15 19:55:42,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:42,889 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:55:42,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-15 19:55:42,890 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:55:42,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-15 19:55:42,891 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981 2023-11-15 19:55:42,892 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981 empty. 2023-11-15 19:55:42,892 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981 2023-11-15 19:55:42,892 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-15 19:55:42,901 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-15 19:55:42,902 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 614c1adb45ce27804137200be2472981, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:42,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:42,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 614c1adb45ce27804137200be2472981, disabling compactions & flushes 2023-11-15 19:55:42,906 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:42,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:42,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. after waiting 0 ms 2023-11-15 19:55:42,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:42,906 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:42,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:42,908 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:55:42,909 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700078142909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078142909"}]},"ts":"1700078142909"} 2023-11-15 19:55:42,910 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-15 19:55:42,911 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:55:42,911 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078142911"}]},"ts":"1700078142911"} 2023-11-15 19:55:42,912 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-15 19:55:42,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=614c1adb45ce27804137200be2472981, ASSIGN}] 2023-11-15 19:55:42,916 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=614c1adb45ce27804137200be2472981, ASSIGN 2023-11-15 19:55:42,917 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=614c1adb45ce27804137200be2472981, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:42,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-15 19:55:43,068 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=614c1adb45ce27804137200be2472981, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,068 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700078143068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078143068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078143068"}]},"ts":"1700078143068"} 2023-11-15 19:55:43,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 614c1adb45ce27804137200be2472981, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:43,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-15 19:55:43,221 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:43,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 614c1adb45ce27804137200be2472981, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981.', STARTKEY => '', ENDKEY => ''} 2023-11-15 19:55:43,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 614c1adb45ce27804137200be2472981 2023-11-15 19:55:43,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:43,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 614c1adb45ce27804137200be2472981 2023-11-15 19:55:43,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 614c1adb45ce27804137200be2472981 2023-11-15 19:55:43,225 INFO [StoreOpener-614c1adb45ce27804137200be2472981-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 614c1adb45ce27804137200be2472981 2023-11-15 19:55:43,226 DEBUG [StoreOpener-614c1adb45ce27804137200be2472981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:43,226 DEBUG [StoreOpener-614c1adb45ce27804137200be2472981-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:43,226 INFO [StoreOpener-614c1adb45ce27804137200be2472981-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 614c1adb45ce27804137200be2472981 columnFamilyName family1 2023-11-15 19:55:43,227 INFO [StoreOpener-614c1adb45ce27804137200be2472981-1] regionserver.HStore(310): Store=614c1adb45ce27804137200be2472981/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:43,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981 2023-11-15 19:55:43,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981 2023-11-15 19:55:43,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 614c1adb45ce27804137200be2472981 2023-11-15 19:55:43,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:43,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 614c1adb45ce27804137200be2472981; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61745082, jitterRate=-0.07992658019065857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-15 19:55:43,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:43,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981., pid=114, masterSystemTime=1700078143221 2023-11-15 19:55:43,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:43,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:43,235 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=614c1adb45ce27804137200be2472981, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,235 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700078143234"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078143234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078143234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078143234"}]},"ts":"1700078143234"} 2023-11-15 19:55:43,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-15 19:55:43,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 614c1adb45ce27804137200be2472981, server=jenkins-hbase4.apache.org,42249,1700078002491 in 167 msec 2023-11-15 19:55:43,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-15 19:55:43,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=614c1adb45ce27804137200be2472981, ASSIGN in 322 msec 2023-11-15 19:55:43,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:55:43,238 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078143238"}]},"ts":"1700078143238"} 2023-11-15 19:55:43,239 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-15 19:55:43,241 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:55:43,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 354 msec 2023-11-15 19:55:43,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-15 19:55:43,493 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-15 19:55:43,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:43,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,514 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:43,514 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:43,514 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:43,514 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:43,514 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,514 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,517 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:43,517 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:43,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:43,517 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,517 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:43,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:43,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,518 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:43,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:43,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:43,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:43,518 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:43,518 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:43,518 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:43,519 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-15 19:55:43,537 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113065499d9f0cbd4563b8dd0f85d6d95978 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113065499d9f0cbd4563b8dd0f85d6d95978 2023-11-15 19:55:43,940 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/ef4daec5760442f783afe0db7439e8e6 2023-11-15 19:55:43,944 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/ef4daec5760442f783afe0db7439e8e6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/ef4daec5760442f783afe0db7439e8e6 2023-11-15 19:55:43,948 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/ef4daec5760442f783afe0db7439e8e6, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-15 19:55:43,948 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 429ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:43,948 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:43,949 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:43,949 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:43,954 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,954 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:43,954 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,954 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:43,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:43,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:43,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:43,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@570bf273[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:43,956 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:43,956 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,957 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,957 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:43,958 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:43,958 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:43,958 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,958 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:43,959 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:43,959 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:43,959 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,959 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:43,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:43,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:43,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:43,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:43,961 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:43,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:43,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:43,961 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,961 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:43,964 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,964 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:43,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,964 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:43,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:43,965 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:43,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,966 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:43,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:43,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:43,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:43,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:43,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:43,968 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:43,968 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:43,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:43,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:43,969 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,069 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:44,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:44,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:44,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:44,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,075 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:44,075 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:44,075 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:44,075 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:44,076 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,076 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,077 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:44,077 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:44,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:44,077 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,077 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:44,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:44,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:44,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:44,078 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:44,079 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:44,079 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:44,079 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-15 19:55:44,489 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128112a9efbf5cb41eb9bc2c43778eb8f99 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128112a9efbf5cb41eb9bc2c43778eb8f99 2023-11-15 19:55:44,894 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/f101999a3e144718b9388d9446124c8d 2023-11-15 19:55:44,898 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/f101999a3e144718b9388d9446124c8d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/f101999a3e144718b9388d9446124c8d 2023-11-15 19:55:44,901 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/f101999a3e144718b9388d9446124c8d, entries=1, sequenceid=9, filesize=5.0 K 2023-11-15 19:55:44,902 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 823ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:44,903 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:44,903 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,905 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:44,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:44,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20ceb8d0[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:44,907 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:44,907 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,908 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:44,909 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,909 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:44,910 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:44,912 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:44,912 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:44,912 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:44,912 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,912 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:44,914 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,914 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,914 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:44,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:44,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:44,915 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,916 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,918 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,918 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:44,918 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:44,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:44,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:44,918 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:44,919 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:44,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:44,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,919 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:44,919 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:44,919 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:44,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:45,019 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:45,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:45,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:45,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,025 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:45,025 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:45,025 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:45,025 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:45,026 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,026 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,028 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:45,028 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:45,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:45,028 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,028 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:45,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:45,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,029 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,029 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:45,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,029 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:45,029 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:45,029 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:45,030 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:45,030 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:45,030 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:45,030 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:45,030 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:45,440 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201be5151f15c5d4effb4045ea4192c7a4e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201be5151f15c5d4effb4045ea4192c7a4e 2023-11-15 19:55:45,845 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/6a2ac684ba1b4f78a676aa7a872e64a1 2023-11-15 19:55:45,849 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/6a2ac684ba1b4f78a676aa7a872e64a1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/6a2ac684ba1b4f78a676aa7a872e64a1 2023-11-15 19:55:45,852 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/6a2ac684ba1b4f78a676aa7a872e64a1, entries=1, sequenceid=13, filesize=4.9 K 2023-11-15 19:55:45,853 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 823ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:45,853 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:45,853 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:45,853 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:45,853 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:45,853 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,853 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:45,853 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,855 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:45,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:45,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75f0d09d[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:45,857 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:45,857 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,858 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:45,859 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,859 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:45,860 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:45,860 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:45,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:45,862 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:45,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:45,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:45,862 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,862 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:45,865 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,865 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:45,865 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:45,866 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,867 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:45,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:45,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:45,877 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:45,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:45,877 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:45,878 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:45,878 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,878 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,978 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:45,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:45,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:45,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:45,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,983 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:45,984 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:45,984 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:45,984 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:45,984 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,984 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,985 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,985 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:45,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:45,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:45,986 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:45,986 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,986 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,987 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:45,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:45,987 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:45,987 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:45,987 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:45,987 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:45,987 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:45,987 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:45,987 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:45,987 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:45,996 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120524f2989f6dc348dfb2f92d094cc34f33 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120524f2989f6dc348dfb2f92d094cc34f33 2023-11-15 19:55:46,401 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/3c501c8cfc154d90bf59a5a77745b109 2023-11-15 19:55:46,405 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/3c501c8cfc154d90bf59a5a77745b109 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3c501c8cfc154d90bf59a5a77745b109 2023-11-15 19:55:46,409 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3c501c8cfc154d90bf59a5a77745b109, entries=1, sequenceid=17, filesize=4.9 K 2023-11-15 19:55:46,410 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 423ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:46,410 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:46,410 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:46,410 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:46,410 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:46,410 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,410 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:46,410 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:46,422 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,422 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:46,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:46,422 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,422 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:46,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:46,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:46,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:46,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:46,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fc5bb89[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:46,424 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:46,424 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,428 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,428 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:46,428 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:46,428 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:46,428 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,428 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:46,431 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:46,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:46,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:46,434 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:46,434 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:46,434 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:46,434 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,434 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:46,437 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,437 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:46,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,437 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:46,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:46,437 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,439 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:46,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:46,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,442 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:46,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,442 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,443 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,542 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:46,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:46,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,549 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:46,549 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:46,549 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:46,549 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:46,549 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,549 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,552 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:46,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:46,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:46,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,552 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:46,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:46,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,553 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:46,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:46,558 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:46,558 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:46,558 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:46,573 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281a0f6b6feb3049378e9dbbe4e4f4c04f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281a0f6b6feb3049378e9dbbe4e4f4c04f 2023-11-15 19:55:46,579 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/c7ec1fa3305e475d846abecce944f5f6 2023-11-15 19:55:46,583 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/c7ec1fa3305e475d846abecce944f5f6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/c7ec1fa3305e475d846abecce944f5f6 2023-11-15 19:55:46,587 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/c7ec1fa3305e475d846abecce944f5f6, entries=1, sequenceid=21, filesize=4.9 K 2023-11-15 19:55:46,587 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 29ms, sequenceid=21, compaction requested=true 2023-11-15 19:55:46,587 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:46,588 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:46,588 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77d55668[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:46,592 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:46,592 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,593 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,593 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:46,594 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:46,594 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:46,594 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,594 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:46,595 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:46,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:46,598 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:46,598 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:46,598 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:46,598 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,598 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:46,601 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,601 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:46,601 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,602 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:46,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,603 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:46,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:46,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:46,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:46,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,605 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:46,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:46,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:55:46,605 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,606 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,606 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,606 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:46,606 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:46,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:46,706 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:46,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:46,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:46,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:46,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,712 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,714 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,714 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:46,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:46,714 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:46,715 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,716 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:46,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:46,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:46,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:46,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:46,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:46,716 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:46,716 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:46,716 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:46,716 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:47,128 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a0ef62fef1124d1dac377f83505af025 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a0ef62fef1124d1dac377f83505af025 2023-11-15 19:55:47,534 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/7e03990a1bee45a39e28d75d585a09a3 2023-11-15 19:55:47,538 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/7e03990a1bee45a39e28d75d585a09a3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/7e03990a1bee45a39e28d75d585a09a3 2023-11-15 19:55:47,540 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/7e03990a1bee45a39e28d75d585a09a3, entries=1, sequenceid=25, filesize=4.9 K 2023-11-15 19:55:47,541 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 825ms, sequenceid=25, compaction requested=true 2023-11-15 19:55:47,541 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:47,541 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:47,543 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:47,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:47,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,543 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:47,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:47,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2208687a[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:47,545 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:47,545 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,547 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:47,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:47,548 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:47,548 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,548 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:47,553 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:47,553 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,554 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:47,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:47,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:47,556 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:47,556 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:47,556 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:47,556 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,556 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:47,558 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,558 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:47,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,558 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:47,558 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:47,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,560 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:47,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,562 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:47,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:47,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:47,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:47,562 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,663 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:47,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:47,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:47,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:47,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,668 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:47,668 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:47,668 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:47,668 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:47,669 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,669 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,671 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:47,671 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:47,671 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:47,671 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,672 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,672 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:47,672 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:47,672 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:47,672 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:47,673 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:47,673 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:48,083 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018e67cb9257bb430dbf34b85340c38e29 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018e67cb9257bb430dbf34b85340c38e29 2023-11-15 19:55:48,488 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/806db0c9da504b60a76e1ca0dbafa687 2023-11-15 19:55:48,492 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/806db0c9da504b60a76e1ca0dbafa687 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/806db0c9da504b60a76e1ca0dbafa687 2023-11-15 19:55:48,495 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/806db0c9da504b60a76e1ca0dbafa687, entries=1, sequenceid=29, filesize=4.9 K 2023-11-15 19:55:48,496 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 823ms, sequenceid=29, compaction requested=true 2023-11-15 19:55:48,496 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:48,496 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:48,498 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:48,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:48,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@518f309e[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:48,500 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:48,500 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,501 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:48,501 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:48,501 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,501 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:48,502 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:48,503 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:48,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:48,505 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:48,505 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:48,505 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:48,505 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,505 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:48,507 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,507 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,507 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:48,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,508 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,509 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,511 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,511 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:48,512 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:48,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:48,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:48,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:48,512 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:48,612 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:48,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:48,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:48,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:48,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,618 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:48,618 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:48,618 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:48,618 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:48,619 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,619 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,620 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:48,620 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:48,621 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:48,621 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,621 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,621 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:48,622 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:48,622 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:48,622 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:48,762 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:55:49,033 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034ecc77a15c4a45de8453af0ad2a32a52 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034ecc77a15c4a45de8453af0ad2a32a52 2023-11-15 19:55:49,438 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/a44c80d52bc545968f246d016deffd22 2023-11-15 19:55:49,442 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/a44c80d52bc545968f246d016deffd22 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/a44c80d52bc545968f246d016deffd22 2023-11-15 19:55:49,445 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/a44c80d52bc545968f246d016deffd22, entries=1, sequenceid=33, filesize=4.9 K 2023-11-15 19:55:49,446 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 824ms, sequenceid=33, compaction requested=true 2023-11-15 19:55:49,446 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:49,446 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:49,446 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:49,446 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:49,446 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,446 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:49,446 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:49,463 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:49,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:49,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,463 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:49,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:49,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:49,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@344d0d5[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:49,465 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:49,465 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,481 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,482 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:49,482 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:49,482 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:49,482 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,482 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:49,492 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:49,492 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:49,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:49,495 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:49,495 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:49,495 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:49,495 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,495 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:49,498 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,498 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:49,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:49,498 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:49,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:49,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:49,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:49,499 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,500 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,503 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,503 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,503 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,503 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:49,503 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:49,503 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:49,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:49,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:49,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:49,503 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:49,504 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,504 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,504 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,504 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:49,504 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:49,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:49,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:49,604 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:49,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:49,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:49,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:49,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,610 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:49,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:49,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:49,610 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:49,611 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,611 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,613 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,613 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:49,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:49,613 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,613 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:49,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,614 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:49,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,614 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:49,614 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:49,614 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:49,614 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:49,614 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:49,614 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:49,615 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:49,615 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:49,624 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070275ad1281294a288d4a372773f0f959 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509070275ad1281294a288d4a372773f0f959 2023-11-15 19:55:49,629 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/87b75dec82724ac0acf795888b4ae2e4 2023-11-15 19:55:49,632 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/87b75dec82724ac0acf795888b4ae2e4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/87b75dec82724ac0acf795888b4ae2e4 2023-11-15 19:55:49,636 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/87b75dec82724ac0acf795888b4ae2e4, entries=1, sequenceid=37, filesize=4.9 K 2023-11-15 19:55:49,636 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 21ms, sequenceid=37, compaction requested=true 2023-11-15 19:55:49,636 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:49,636 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:49,636 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:49,636 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:49,636 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,636 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:49,636 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:49,640 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,640 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:49,641 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,641 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5effb0c3[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:49,642 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:49,642 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,644 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,644 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:49,644 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,644 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:49,644 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:49,644 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:49,645 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:49,645 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:49,645 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,645 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:49,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:49,648 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:49,648 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:49,648 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:49,648 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,648 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:49,650 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,650 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:49,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,650 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:49,651 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,652 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,654 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,654 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:49,654 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,654 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:49,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:55:49,654 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:49,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:49,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:49,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:49,654 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:49,654 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,655 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,655 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,655 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:49,655 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:49,655 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:49,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:49,755 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:49,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:49,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:49,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:49,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,760 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:49,760 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:49,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-15 19:55:49,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-15 19:55:49,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,761 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,762 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,762 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:49,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:49,763 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:49,763 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-15 19:55:49,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:49,764 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-15 19:55:49,764 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:49,764 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-15 19:55:49,764 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-15 19:55:49,764 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:49,764 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:49,764 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. started... 2023-11-15 19:55:49,764 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 614c1adb45ce27804137200be2472981 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-15 19:55:50,175 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b5514a26838f4e97aac9093ff48b89a1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b5514a26838f4e97aac9093ff48b89a1 2023-11-15 19:55:50,579 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/e9eef8768d6d420bace2b1eed46cbf72 2023-11-15 19:55:50,583 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/e9eef8768d6d420bace2b1eed46cbf72 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/e9eef8768d6d420bace2b1eed46cbf72 2023-11-15 19:55:50,586 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/e9eef8768d6d420bace2b1eed46cbf72, entries=1, sequenceid=41, filesize=4.9 K 2023-11-15 19:55:50,587 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 614c1adb45ce27804137200be2472981 in 823ms, sequenceid=41, compaction requested=true 2023-11-15 19:55:50,587 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:50,587 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-15 19:55:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-15 19:55:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-15 19:55:50,587 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-15 19:55:50,598 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,598 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:50,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:50,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-15 19:55:50,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f5548de[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:50,600 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-15 19:55:50,600 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,603 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,603 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-15 19:55:50,603 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-15 19:55:50,603 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:50,603 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,603 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-15 19:55:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:50,607 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-15 19:55:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:50,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-15 19:55:50,609 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-15 19:55:50,609 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:50,609 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:50,609 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,609 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:50,612 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,612 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:50,612 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,613 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:50,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,614 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,616 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,616 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:50,616 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:50,616 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:50,616 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-15 19:55:50,616 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:50,616 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:50,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-15 19:55:50,617 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:50,617 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:50,617 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:50,617 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:50,617 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:50,717 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:50,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:50,719 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-15 19:55:50,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:55:50,721 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:55:50,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:55:50,722 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078750722 2023-11-15 19:55:50,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-15 19:55:50,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-15 19:55:50,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:50,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x05995854 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:55:50,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@164e7711, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:55:50,730 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,561 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103856ce14cb152453bb80c1199e08a3762 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103856ce14cb152453bb80c1199e08a3762 2023-11-15 19:55:51,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:51,576 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:55:51,578 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:55:51,584 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:55:51,585 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:55:51,592 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c533cb6753da4be6959c183f0d1e04df first=Optional[r5] last=Optional[r6] 2023-11-15 19:55:51,593 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c533cb6753da4be6959c183f0d1e04df}] 2023-11-15 19:55:51,597 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c533cb6753da4be6959c183f0d1e04df for inclusion in 614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:51,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-15 19:55:51,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:55:51,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:51,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c533cb6753da4be6959c183f0d1e04df to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k806jq811bru73gegjbffqhvna0iced453c720h6on1bck1su283ds5rsbsdeb5j/family1/c533cb6753da4be6959c183f0d1e04df 2023-11-15 19:55:51,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k806jq811bru73gegjbffqhvna0iced453c720h6on1bck1su283ds5rsbsdeb5j/family1/c533cb6753da4be6959c183f0d1e04df as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_ 2023-11-15 19:55:51,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k806jq811bru73gegjbffqhvna0iced453c720h6on1bck1su283ds5rsbsdeb5j/family1/c533cb6753da4be6959c183f0d1e04df into 614c1adb45ce27804137200be2472981/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_ - updating store file list. 2023-11-15 19:55:51,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_ into 614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:51,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k806jq811bru73gegjbffqhvna0iced453c720h6on1bck1su283ds5rsbsdeb5j/family1/c533cb6753da4be6959c183f0d1e04df into 614c1adb45ce27804137200be2472981/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_) 2023-11-15 19:55:51,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k806jq811bru73gegjbffqhvna0iced453c720h6on1bck1su283ds5rsbsdeb5j/family1/c533cb6753da4be6959c183f0d1e04df 2023-11-15 19:55:51,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-15 19:55:51,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-15 19:55:51,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(1912): 614c1adb45ce27804137200be2472981/family1 is initiating minor compaction 2023-11-15 19:55:51,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b4d5258; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:55:51,611 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 614c1adb45ce27804137200be2472981/family1 in testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:55:51,611 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/f101999a3e144718b9388d9446124c8d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/6a2ac684ba1b4f78a676aa7a872e64a1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3c501c8cfc154d90bf59a5a77745b109, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/c7ec1fa3305e475d846abecce944f5f6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/7e03990a1bee45a39e28d75d585a09a3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/806db0c9da504b60a76e1ca0dbafa687, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/a44c80d52bc545968f246d016deffd22, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/87b75dec82724ac0acf795888b4ae2e4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/e9eef8768d6d420bace2b1eed46cbf72, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp, totalSize=49.7 K 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting f101999a3e144718b9388d9446124c8d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 6a2ac684ba1b4f78a676aa7a872e64a1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3c501c8cfc154d90bf59a5a77745b109, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting c7ec1fa3305e475d846abecce944f5f6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 7e03990a1bee45a39e28d75d585a09a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 806db0c9da504b60a76e1ca0dbafa687, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting a44c80d52bc545968f246d016deffd22, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 87b75dec82724ac0acf795888b4ae2e4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting e9eef8768d6d420bace2b1eed46cbf72, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-15 19:55:51,611 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] compactions.Compactor(207): Compacting 3568daca6a00480da6b3751a76143c67_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-15 19:55:51,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:51,613 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:51,615 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018e67cb9257bb430dbf34b85340c38e29 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018e67cb9257bb430dbf34b85340c38e29 2023-11-15 19:55:51,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034ecc77a15c4a45de8453af0ad2a32a52 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034ecc77a15c4a45de8453af0ad2a32a52 2023-11-15 19:55:51,616 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-15 19:55:51,616 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-15 19:55:51,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,645 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] throttle.PressureAwareThroughputController(145): 614c1adb45ce27804137200be2472981#family1#compaction#165 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:55:51,664 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ff14e6d803444e868f146763e65d1ae6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff14e6d803444e868f146763e65d1ae6 2023-11-15 19:55:51,664 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:51,685 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c4fb2388e514512a4a62e22f01587ca first=Optional[r1] last=Optional[r4] 2023-11-15 19:55:51,685 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c4fb2388e514512a4a62e22f01587ca}] 2023-11-15 19:55:51,687 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c4fb2388e514512a4a62e22f01587ca for inclusion in 614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:51,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-15 19:55:51,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:55:51,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:51,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c4fb2388e514512a4a62e22f01587ca to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__13ki6vdakon4m4vavei2ek5sucuf5fsjfj2ssptj0vkdldrftgsb29f3p5cje563/family1/6c4fb2388e514512a4a62e22f01587ca 2023-11-15 19:55:51,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__13ki6vdakon4m4vavei2ek5sucuf5fsjfj2ssptj0vkdldrftgsb29f3p5cje563/family1/6c4fb2388e514512a4a62e22f01587ca as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/834d71da83824e40992459b5e897278c_SeqId_46_ 2023-11-15 19:55:51,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__13ki6vdakon4m4vavei2ek5sucuf5fsjfj2ssptj0vkdldrftgsb29f3p5cje563/family1/6c4fb2388e514512a4a62e22f01587ca into 614c1adb45ce27804137200be2472981/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/834d71da83824e40992459b5e897278c_SeqId_46_ - updating store file list. 2023-11-15 19:55:51,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/834d71da83824e40992459b5e897278c_SeqId_46_ into 614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:51,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__13ki6vdakon4m4vavei2ek5sucuf5fsjfj2ssptj0vkdldrftgsb29f3p5cje563/family1/6c4fb2388e514512a4a62e22f01587ca into 614c1adb45ce27804137200be2472981/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/834d71da83824e40992459b5e897278c_SeqId_46_) 2023-11-15 19:55:51,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__13ki6vdakon4m4vavei2ek5sucuf5fsjfj2ssptj0vkdldrftgsb29f3p5cje563/family1/6c4fb2388e514512a4a62e22f01587ca 2023-11-15 19:55:51,696 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:51,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:51,697 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201be5151f15c5d4effb4045ea4192c7a4e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201be5151f15c5d4effb4045ea4192c7a4e 2023-11-15 19:55:51,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120524f2989f6dc348dfb2f92d094cc34f33 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120524f2989f6dc348dfb2f92d094cc34f33 2023-11-15 19:55:51,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281a0f6b6feb3049378e9dbbe4e4f4c04f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281a0f6b6feb3049378e9dbbe4e4f4c04f 2023-11-15 19:55:51,699 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a0ef62fef1124d1dac377f83505af025 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a0ef62fef1124d1dac377f83505af025 2023-11-15 19:55:51,699 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-15 19:55:51,699 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-15 19:55:51,700 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,700 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,737 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113098d93a91ddf844b7ad63cd80c912fa26 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113098d93a91ddf844b7ad63cd80c912fa26 2023-11-15 19:55:51,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:51,759 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3692a0cb641a4277b19c86a332d3d5e8 first=Optional[r00] last=Optional[r8] 2023-11-15 19:55:51,760 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3692a0cb641a4277b19c86a332d3d5e8}] 2023-11-15 19:55:51,762 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3692a0cb641a4277b19c86a332d3d5e8 for inclusion in 614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-15 19:55:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last= 2023-11-15 19:55:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:51,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3692a0cb641a4277b19c86a332d3d5e8 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58kcmfv8ai7usmvut269k6hiqfd8aqi8rrlaukcm7tnhhk6sffc3ndefup6ntsrb/family1/3692a0cb641a4277b19c86a332d3d5e8 2023-11-15 19:55:51,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58kcmfv8ai7usmvut269k6hiqfd8aqi8rrlaukcm7tnhhk6sffc3ndefup6ntsrb/family1/3692a0cb641a4277b19c86a332d3d5e8 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/1c4681564bc04c00a70e2eca9e51fd8b_SeqId_48_ 2023-11-15 19:55:51,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58kcmfv8ai7usmvut269k6hiqfd8aqi8rrlaukcm7tnhhk6sffc3ndefup6ntsrb/family1/3692a0cb641a4277b19c86a332d3d5e8 into 614c1adb45ce27804137200be2472981/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/1c4681564bc04c00a70e2eca9e51fd8b_SeqId_48_ - updating store file list. 2023-11-15 19:55:51,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/1c4681564bc04c00a70e2eca9e51fd8b_SeqId_48_ into 614c1adb45ce27804137200be2472981/family1 2023-11-15 19:55:51,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58kcmfv8ai7usmvut269k6hiqfd8aqi8rrlaukcm7tnhhk6sffc3ndefup6ntsrb/family1/3692a0cb641a4277b19c86a332d3d5e8 into 614c1adb45ce27804137200be2472981/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/1c4681564bc04c00a70e2eca9e51fd8b_SeqId_48_) 2023-11-15 19:55:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58kcmfv8ai7usmvut269k6hiqfd8aqi8rrlaukcm7tnhhk6sffc3ndefup6ntsrb/family1/3692a0cb641a4277b19c86a332d3d5e8 2023-11-15 19:55:51,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] compactions.SortedCompactionPolicy(75): Selecting compaction from 13 store files, 10 compacting, 2 eligible, 16 blocking 2023-11-15 19:55:51,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-15 19:55:51,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-15 19:55:51,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.CompactSplit(415): Not compacting testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. because compaction request was cancelled 2023-11-15 19:55:51,772 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:51,773 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:51,774 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b5514a26838f4e97aac9093ff48b89a1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b5514a26838f4e97aac9093ff48b89a1 2023-11-15 19:55:51,775 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128112a9efbf5cb41eb9bc2c43778eb8f99 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128112a9efbf5cb41eb9bc2c43778eb8f99 2023-11-15 19:55:51,776 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113065499d9f0cbd4563b8dd0f85d6d95978 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113065499d9f0cbd4563b8dd0f85d6d95978 2023-11-15 19:55:51,776 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-15 19:55:51,776 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-15 19:55:51,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-15 19:55:51,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-15 19:55:51,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:55:51,779 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-15 19:55:51,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.0590 sec 2023-11-15 19:55:52,005 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=269 (was 250) - Thread LEAK? -, OpenFileDescriptor=695 (was 673) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=143 (was 151), ProcessCount=169 (was 170), AvailableMemoryMB=1243 (was 1245) 2023-11-15 19:55:52,017 INFO [Listener at localhost/43577] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=269, OpenFileDescriptor=695, MaxFileDescriptor=60000, SystemLoadAverage=143, ProcessCount=169, AvailableMemoryMB=1243 2023-11-15 19:55:52,036 DEBUG [Listener at localhost/43577] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-15 19:55:52,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFD\x04\xE1\xD5\x81\xFD\xD7 \x11*\x821Lp>\xB7"\x10\xF7\xE9}j\x8D\x9C\x1Am5]\x11\xAE\x8C\x80`\x1B*\x106`u\xF6\xD4J\x94\xF5\x9D'\xA9Im\xD3\xF7t2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-15 19:55:52,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-15 19:55:52,093 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-15 19:55:52,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-15 19:55:52,093 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-15 19:55:52,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-15 19:55:52,095 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:52,095 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:52,095 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:52,096 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba empty. 2023-11-15 19:55:52,096 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203 empty. 2023-11-15 19:55:52,096 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3 empty. 2023-11-15 19:55:52,096 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:52,096 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:52,096 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:52,096 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-15 19:55:52,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-15 19:55:52,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-15 19:55:52,463 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/.tmp/family1/fd2c9e6ae71e4251ba158aa52cd90090 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/fd2c9e6ae71e4251ba158aa52cd90090 2023-11-15 19:55:52,468 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 614c1adb45ce27804137200be2472981/family1 of 614c1adb45ce27804137200be2472981 into fd2c9e6ae71e4251ba158aa52cd90090(size=6.6 K), total size for store is 344.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:55:52,468 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:55:52,468 INFO [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700078151610; duration=0sec 2023-11-15 19:55:52,468 DEBUG [RS:0;jenkins-hbase4:42249-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-15 19:55:52,503 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-15 19:55:52,504 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 7b31c220251c7cd4674568bbe1cee203, NAME => 'testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFD\x04\xE1\xD5\x81\xFD\xD7 \x11*\x821Lp>\xB7"\x10\xF7\xE9}j\x8D\x9C\x1Am5]\x11\xAE\x8C\x80`\x1B*\x106`u\xF6\xD4J\x94\xF5\x9D'\xA9Im\xD3\xF7t2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:52,504 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1832f52a2a4870c6e6f331ad6393f6b3, NAME => 'testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFD\x04\xE1\xD5\x81\xFD\xD7 \x11*\x821Lp>\xB7"\x10\xF7\xE9}j\x8D\x9C\x1Am5]\x11\xAE\x8C\x80`\x1B*\x106`u\xF6\xD4J\x94\xF5\x9D'\xA9Im\xD3\xF7t2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:52,504 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => a1b7e9aa0f9b5a0f41ded90bdb3eefba, NAME => 'testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFD\x04\xE1\xD5\x81\xFD\xD7 \x11*\x821Lp>\xB7"\x10\xF7\xE9}j\x8D\x9C\x1Am5]\x11\xAE\x8C\x80`\x1B*\x106`u\xF6\xD4J\x94\xF5\x9D'\xA9Im\xD3\xF7t2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/.tmp 2023-11-15 19:55:52,514 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:52,515 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 1832f52a2a4870c6e6f331ad6393f6b3, disabling compactions & flushes 2023-11-15 19:55:52,515 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:52,515 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:52,515 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. after waiting 0 ms 2023-11-15 19:55:52,515 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:52,515 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:52,515 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:55:52,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/f101999a3e144718b9388d9446124c8d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/6a2ac684ba1b4f78a676aa7a872e64a1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3c501c8cfc154d90bf59a5a77745b109, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/c7ec1fa3305e475d846abecce944f5f6, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/7e03990a1bee45a39e28d75d585a09a3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/806db0c9da504b60a76e1ca0dbafa687, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/a44c80d52bc545968f246d016deffd22, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/87b75dec82724ac0acf795888b4ae2e4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/e9eef8768d6d420bace2b1eed46cbf72, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_] to archive 2023-11-15 19:55:52,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:55:52,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/f101999a3e144718b9388d9446124c8d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/f101999a3e144718b9388d9446124c8d 2023-11-15 19:55:52,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/6a2ac684ba1b4f78a676aa7a872e64a1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/6a2ac684ba1b4f78a676aa7a872e64a1 2023-11-15 19:55:52,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3c501c8cfc154d90bf59a5a77745b109 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3c501c8cfc154d90bf59a5a77745b109 2023-11-15 19:55:52,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/c7ec1fa3305e475d846abecce944f5f6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/c7ec1fa3305e475d846abecce944f5f6 2023-11-15 19:55:52,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/7e03990a1bee45a39e28d75d585a09a3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/7e03990a1bee45a39e28d75d585a09a3 2023-11-15 19:55:52,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/806db0c9da504b60a76e1ca0dbafa687 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/806db0c9da504b60a76e1ca0dbafa687 2023-11-15 19:55:52,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/a44c80d52bc545968f246d016deffd22 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/a44c80d52bc545968f246d016deffd22 2023-11-15 19:55:52,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/87b75dec82724ac0acf795888b4ae2e4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/87b75dec82724ac0acf795888b4ae2e4 2023-11-15 19:55:52,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/e9eef8768d6d420bace2b1eed46cbf72 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/e9eef8768d6d420bace2b1eed46cbf72 2023-11-15 19:55:52,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_ to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/family1/3568daca6a00480da6b3751a76143c67_SeqId_44_ 2023-11-15 19:55:52,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-15 19:55:52,913 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:52,913 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 7b31c220251c7cd4674568bbe1cee203, disabling compactions & flushes 2023-11-15 19:55:52,913 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:52,913 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:52,913 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. after waiting 0 ms 2023-11-15 19:55:52,913 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:52,913 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:52,913 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:55:52,914 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:52,914 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing a1b7e9aa0f9b5a0f41ded90bdb3eefba, disabling compactions & flushes 2023-11-15 19:55:52,914 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:52,914 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:52,914 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. after waiting 0 ms 2023-11-15 19:55:52,914 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:52,914 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:52,914 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:55:52,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-15 19:55:52,917 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700078152917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078152917"}]},"ts":"1700078152917"} 2023-11-15 19:55:52,917 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078152917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078152917"}]},"ts":"1700078152917"} 2023-11-15 19:55:52,917 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078152917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700078152917"}]},"ts":"1700078152917"} 2023-11-15 19:55:52,919 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-15 19:55:52,919 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-15 19:55:52,919 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078152919"}]},"ts":"1700078152919"} 2023-11-15 19:55:52,920 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-15 19:55:52,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a1b7e9aa0f9b5a0f41ded90bdb3eefba, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1832f52a2a4870c6e6f331ad6393f6b3, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7b31c220251c7cd4674568bbe1cee203, ASSIGN}] 2023-11-15 19:55:52,925 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1832f52a2a4870c6e6f331ad6393f6b3, ASSIGN 2023-11-15 19:55:52,925 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a1b7e9aa0f9b5a0f41ded90bdb3eefba, ASSIGN 2023-11-15 19:55:52,925 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7b31c220251c7cd4674568bbe1cee203, ASSIGN 2023-11-15 19:55:52,926 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1832f52a2a4870c6e6f331ad6393f6b3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:52,926 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a1b7e9aa0f9b5a0f41ded90bdb3eefba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:52,926 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7b31c220251c7cd4674568bbe1cee203, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42249,1700078002491; forceNewPlan=false, retain=false 2023-11-15 19:55:53,078 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1832f52a2a4870c6e6f331ad6393f6b3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:53,078 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=a1b7e9aa0f9b5a0f41ded90bdb3eefba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:53,079 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700078153078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078153078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078153078"}]},"ts":"1700078153078"} 2023-11-15 19:55:53,079 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078153078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078153078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078153078"}]},"ts":"1700078153078"} 2023-11-15 19:55:53,078 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=7b31c220251c7cd4674568bbe1cee203, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:53,079 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078153078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700078153078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700078153078"}]},"ts":"1700078153078"} 2023-11-15 19:55:53,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 1832f52a2a4870c6e6f331ad6393f6b3, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:53,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure a1b7e9aa0f9b5a0f41ded90bdb3eefba, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:53,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 7b31c220251c7cd4674568bbe1cee203, server=jenkins-hbase4.apache.org,42249,1700078002491}] 2023-11-15 19:55:53,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-15 19:55:53,232 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:53,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:53,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b31c220251c7cd4674568bbe1cee203, NAME => 'testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203.', STARTKEY => '2', ENDKEY => ''} 2023-11-15 19:55:53,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:53,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,256 INFO [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,257 DEBUG [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1 2023-11-15 19:55:53,258 DEBUG [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1 2023-11-15 19:55:53,258 INFO [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b31c220251c7cd4674568bbe1cee203 columnFamilyName family1 2023-11-15 19:55:53,259 INFO [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] regionserver.HStore(310): Store=7b31c220251c7cd4674568bbe1cee203/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:53,259 INFO [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,260 DEBUG [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2 2023-11-15 19:55:53,260 DEBUG [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2 2023-11-15 19:55:53,261 INFO [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b31c220251c7cd4674568bbe1cee203 columnFamilyName family2 2023-11-15 19:55:53,262 INFO [StoreOpener-7b31c220251c7cd4674568bbe1cee203-1] regionserver.HStore(310): Store=7b31c220251c7cd4674568bbe1cee203/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:53,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:53,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:55:53,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:53,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b31c220251c7cd4674568bbe1cee203; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64601127, jitterRate=-0.03736819326877594}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:53,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:55:53,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203., pid=122, masterSystemTime=1700078153231 2023-11-15 19:55:53,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:53,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:53,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1832f52a2a4870c6e6f331ad6393f6b3, NAME => 'testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3.', STARTKEY => '1', ENDKEY => '2'} 2023-11-15 19:55:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,269 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=7b31c220251c7cd4674568bbe1cee203, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,269 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078153269"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078153269"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078153269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078153269"}]},"ts":"1700078153269"} 2023-11-15 19:55:53,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-15 19:55:53,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 7b31c220251c7cd4674568bbe1cee203, server=jenkins-hbase4.apache.org,42249,1700078002491 in 189 msec 2023-11-15 19:55:53,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7b31c220251c7cd4674568bbe1cee203, ASSIGN in 348 msec 2023-11-15 19:55:53,295 INFO [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,296 DEBUG [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1 2023-11-15 19:55:53,296 DEBUG [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1 2023-11-15 19:55:53,296 INFO [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1832f52a2a4870c6e6f331ad6393f6b3 columnFamilyName family1 2023-11-15 19:55:53,297 INFO [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] regionserver.HStore(310): Store=1832f52a2a4870c6e6f331ad6393f6b3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:53,297 INFO [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,298 DEBUG [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2 2023-11-15 19:55:53,298 DEBUG [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2 2023-11-15 19:55:53,299 INFO [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1832f52a2a4870c6e6f331ad6393f6b3 columnFamilyName family2 2023-11-15 19:55:53,299 INFO [StoreOpener-1832f52a2a4870c6e6f331ad6393f6b3-1] regionserver.HStore(310): Store=1832f52a2a4870c6e6f331ad6393f6b3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:53,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:53,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:55:53,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:53,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1832f52a2a4870c6e6f331ad6393f6b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69913728, jitterRate=0.04179573059082031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:53,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:55:53,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3., pid=120, masterSystemTime=1700078153231 2023-11-15 19:55:53,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:53,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:53,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:53,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1b7e9aa0f9b5a0f41ded90bdb3eefba, NAME => 'testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba.', STARTKEY => '', ENDKEY => '1'} 2023-11-15 19:55:53,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1832f52a2a4870c6e6f331ad6393f6b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:53,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700078153306"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078153306"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078153306"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078153306"}]},"ts":"1700078153306"} 2023-11-15 19:55:53,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-15 19:55:53,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=118 2023-11-15 19:55:53,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 1832f52a2a4870c6e6f331ad6393f6b3, server=jenkins-hbase4.apache.org,42249,1700078002491 in 227 msec 2023-11-15 19:55:53,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1832f52a2a4870c6e6f331ad6393f6b3, ASSIGN in 386 msec 2023-11-15 19:55:53,327 INFO [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,328 DEBUG [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 2023-11-15 19:55:53,328 DEBUG [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 2023-11-15 19:55:53,328 INFO [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1b7e9aa0f9b5a0f41ded90bdb3eefba columnFamilyName family1 2023-11-15 19:55:53,328 INFO [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] regionserver.HStore(310): Store=a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:53,329 INFO [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,329 DEBUG [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2 2023-11-15 19:55:53,330 DEBUG [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2 2023-11-15 19:55:53,330 INFO [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1b7e9aa0f9b5a0f41ded90bdb3eefba columnFamilyName family2 2023-11-15 19:55:53,330 INFO [StoreOpener-a1b7e9aa0f9b5a0f41ded90bdb3eefba-1] regionserver.HStore(310): Store=a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-15 19:55:53,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-15 19:55:53,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:55:53,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-15 19:55:53,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1b7e9aa0f9b5a0f41ded90bdb3eefba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59287004, jitterRate=-0.11655479669570923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-15 19:55:53,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:55:53,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba., pid=121, masterSystemTime=1700078153231 2023-11-15 19:55:53,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:53,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:53,337 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=a1b7e9aa0f9b5a0f41ded90bdb3eefba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:53,337 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700078153337"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700078153337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700078153337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700078153337"}]},"ts":"1700078153337"} 2023-11-15 19:55:53,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=117 2023-11-15 19:55:53,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure a1b7e9aa0f9b5a0f41ded90bdb3eefba, server=jenkins-hbase4.apache.org,42249,1700078002491 in 257 msec 2023-11-15 19:55:53,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-11-15 19:55:53,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a1b7e9aa0f9b5a0f41ded90bdb3eefba, ASSIGN in 416 msec 2023-11-15 19:55:53,340 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-15 19:55:53,341 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700078153340"}]},"ts":"1700078153340"} 2023-11-15 19:55:53,341 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-15 19:55:53,344 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-15 19:55:53,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2540 sec 2023-11-15 19:55:54,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-15 19:55:54,198 INFO [Listener at localhost/43577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-15 19:55:54,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:54,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:54,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:54,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:54,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-15 19:55:54,208 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-15 19:55:54,208 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:54,208 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-15 19:55:54,208 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-15 19:55:54,208 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:54,208 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:54,210 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:54,210 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:54,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:54,210 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:54,210 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:54,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:54,211 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-15 19:55:54,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-15 19:55:54,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-15 19:55:54,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:54,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-15 19:55:54,211 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:54,211 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. started... 2023-11-15 19:55:54,211 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:54,212 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:54,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:54,212 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b31c220251c7cd4674568bbe1cee203 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:54,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. started... 2023-11-15 19:55:54,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:54,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. started... 2023-11-15 19:55:54,213 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a1b7e9aa0f9b5a0f41ded90bdb3eefba 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:54,213 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1832f52a2a4870c6e6f331ad6393f6b3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-15 19:55:54,265 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115b3fcbff5e9684be4be82fe2473aa62fe to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b3fcbff5e9684be4be82fe2473aa62fe 2023-11-15 19:55:54,274 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111530e2185d1d7a440881d9b63eba3d59b2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111530e2185d1d7a440881d9b63eba3d59b2 2023-11-15 19:55:54,282 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/be1976e07a3f4b8da3a14375be8eb2ea 2023-11-15 19:55:54,284 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115033a4b9194644b44bb2ed1cc9a625ccd to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231115033a4b9194644b44bb2ed1cc9a625ccd 2023-11-15 19:55:54,695 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/f085837d1b9d41d6bbb8534ef70471c4 2023-11-15 19:55:54,705 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/ffce256ab6eb4f0e8a3241e9834dcb1f 2023-11-15 19:55:54,716 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115640453b0a4094901aa5807eee03363d3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231115640453b0a4094901aa5807eee03363d3 2023-11-15 19:55:54,800 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-15 19:55:55,121 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/cec2ee1c63b640e889eab959fa47b400 2023-11-15 19:55:55,125 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/be1976e07a3f4b8da3a14375be8eb2ea as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/be1976e07a3f4b8da3a14375be8eb2ea 2023-11-15 19:55:55,129 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111599eb8f46ca264453bd24a7765799fe8f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023111599eb8f46ca264453bd24a7765799fe8f 2023-11-15 19:55:55,141 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311151d71e42de8ed4badbc74b4ae9def1d31 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311151d71e42de8ed4badbc74b4ae9def1d31 2023-11-15 19:55:55,150 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/be1976e07a3f4b8da3a14375be8eb2ea, entries=4, sequenceid=5, filesize=5.5 K 2023-11-15 19:55:55,150 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/cec2ee1c63b640e889eab959fa47b400 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/cec2ee1c63b640e889eab959fa47b400 2023-11-15 19:55:55,153 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/cec2ee1c63b640e889eab959fa47b400, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:55,154 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a1b7e9aa0f9b5a0f41ded90bdb3eefba in 941ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:55,155 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:55:55,155 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:55,155 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:55,538 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/1ccca77175914cf398ddfd3ea8222866 2023-11-15 19:55:55,542 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/f085837d1b9d41d6bbb8534ef70471c4 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/f085837d1b9d41d6bbb8534ef70471c4 2023-11-15 19:55:55,546 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/ae40dbc7dc9048d393b7f526a7fcd5d3 2023-11-15 19:55:55,549 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/ffce256ab6eb4f0e8a3241e9834dcb1f as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/ffce256ab6eb4f0e8a3241e9834dcb1f 2023-11-15 19:55:55,567 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/f085837d1b9d41d6bbb8534ef70471c4, entries=4, sequenceid=5, filesize=5.5 K 2023-11-15 19:55:55,568 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/1ccca77175914cf398ddfd3ea8222866 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1ccca77175914cf398ddfd3ea8222866 2023-11-15 19:55:55,571 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1ccca77175914cf398ddfd3ea8222866, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:55,572 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7b31c220251c7cd4674568bbe1cee203 in 1360ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:55,572 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:55:55,572 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:55,572 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:55,585 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/ffce256ab6eb4f0e8a3241e9834dcb1f, entries=4, sequenceid=5, filesize=5.5 K 2023-11-15 19:55:55,585 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/ae40dbc7dc9048d393b7f526a7fcd5d3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/ae40dbc7dc9048d393b7f526a7fcd5d3 2023-11-15 19:55:55,589 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/ae40dbc7dc9048d393b7f526a7fcd5d3, entries=2, sequenceid=5, filesize=5.1 K 2023-11-15 19:55:55,590 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1832f52a2a4870c6e6f331ad6393f6b3 in 1377ms, sequenceid=5, compaction requested=false 2023-11-15 19:55:55,590 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:55:55,590 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-15 19:55:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-15 19:55:55,592 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,592 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:55,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:55,592 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,592 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:55,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:55,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:55,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-15 19:55:55,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1776946a[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:55,594 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-15 19:55:55,594 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,595 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,595 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-15 19:55:55,596 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-15 19:55:55,596 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:55,596 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,596 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:55,598 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,598 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-15 19:55:55,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:55,598 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:55,599 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-15 19:55:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:55,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-15 19:55:55,601 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-15 19:55:55,601 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:55,601 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:55,601 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-15 19:55:55,601 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:55,606 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,606 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:55,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,606 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:55,607 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:55,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,609 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:55,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:55,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:55,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:55,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-15 19:55:55,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-15 19:55:55,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:55,611 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:55,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,611 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:55,612 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:55,612 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:55,612 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,612 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:55,612 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:55,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:55,712 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:55,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:55,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:55,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:55,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:55,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:55,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:55,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-15 19:55:55,719 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-15 19:55:55,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:55,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-15 19:55:55,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-15 19:55:55,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,719 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:55,721 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:55,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:55,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:55,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:55,721 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:55,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:55,722 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-15 19:55:55,722 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-15 19:55:55,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-15 19:55:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-15 19:55:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-15 19:55:55,722 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:55,722 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. started... 2023-11-15 19:55:55,723 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b31c220251c7cd4674568bbe1cee203 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:55,723 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:55,723 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:55,723 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. started... 2023-11-15 19:55:55,723 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. started... 2023-11-15 19:55:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:55,723 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a1b7e9aa0f9b5a0f41ded90bdb3eefba 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:55,723 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1832f52a2a4870c6e6f331ad6393f6b3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-15 19:55:56,166 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115b512ce6ad50149ba87fc1f3abee79b94 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b512ce6ad50149ba87fc1f3abee79b94 2023-11-15 19:55:56,166 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311150fa4d03e8e2f4403ab7051f8d00a9296 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311150fa4d03e8e2f4403ab7051f8d00a9296 2023-11-15 19:55:56,180 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111511c9f95affb74e60ae0c685801a05e91 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111511c9f95affb74e60ae0c685801a05e91 2023-11-15 19:55:56,194 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/a05ba42e5f7d423c89791bfd725837fc 2023-11-15 19:55:56,592 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/1f856c3e69ff43909f8d3055b1a60b34 2023-11-15 19:55:56,602 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/1f9a6c09644249189c7f12d517ad0f59 2023-11-15 19:55:56,627 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311151b2adfcaaafe4771b02a67c0cd44756b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311151b2adfcaaafe4771b02a67c0cd44756b 2023-11-15 19:55:56,631 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115e217b60d858344afb1bf9eb050cd400c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231115e217b60d858344afb1bf9eb050cd400c 2023-11-15 19:55:56,636 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/6dcf9032c85e40d2bb38977a4f8b5ca7 2023-11-15 19:55:56,639 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/1f856c3e69ff43909f8d3055b1a60b34 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1f856c3e69ff43909f8d3055b1a60b34 2023-11-15 19:55:56,640 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311159573efd90897448b99bf4f14568c44cf to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311159573efd90897448b99bf4f14568c44cf 2023-11-15 19:55:56,663 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1f856c3e69ff43909f8d3055b1a60b34, entries=4, sequenceid=9, filesize=5.5 K 2023-11-15 19:55:56,664 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/6dcf9032c85e40d2bb38977a4f8b5ca7 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/6dcf9032c85e40d2bb38977a4f8b5ca7 2023-11-15 19:55:56,667 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/6dcf9032c85e40d2bb38977a4f8b5ca7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:56,668 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7b31c220251c7cd4674568bbe1cee203 in 946ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:56,668 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:55:56,668 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:56,668 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:57,032 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/506e00d0df95487dbf7164faec0c5b91 2023-11-15 19:55:57,036 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/a05ba42e5f7d423c89791bfd725837fc as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/a05ba42e5f7d423c89791bfd725837fc 2023-11-15 19:55:57,044 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/e66b7a2d0d8c4642837566b082105401 2023-11-15 19:55:57,048 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/1f9a6c09644249189c7f12d517ad0f59 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1f9a6c09644249189c7f12d517ad0f59 2023-11-15 19:55:57,059 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/a05ba42e5f7d423c89791bfd725837fc, entries=4, sequenceid=9, filesize=5.5 K 2023-11-15 19:55:57,060 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/506e00d0df95487dbf7164faec0c5b91 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/506e00d0df95487dbf7164faec0c5b91 2023-11-15 19:55:57,063 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/506e00d0df95487dbf7164faec0c5b91, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:57,064 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a1b7e9aa0f9b5a0f41ded90bdb3eefba in 1341ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:57,064 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:55:57,064 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:57,064 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:57,077 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1f9a6c09644249189c7f12d517ad0f59, entries=4, sequenceid=9, filesize=5.5 K 2023-11-15 19:55:57,077 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/e66b7a2d0d8c4642837566b082105401 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/e66b7a2d0d8c4642837566b082105401 2023-11-15 19:55:57,080 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/e66b7a2d0d8c4642837566b082105401, entries=2, sequenceid=9, filesize=5.1 K 2023-11-15 19:55:57,081 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1832f52a2a4870c6e6f331ad6393f6b3 in 1358ms, sequenceid=9, compaction requested=false 2023-11-15 19:55:57,081 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:55:57,081 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-15 19:55:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-15 19:55:57,083 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,083 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:57,084 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:57,084 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:57,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:57,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:57,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:57,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-15 19:55:57,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32113c29[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:57,085 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-15 19:55:57,085 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,087 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-15 19:55:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-15 19:55:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:57,087 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,087 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:57,088 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-15 19:55:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:57,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:57,088 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-15 19:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:57,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:57,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:57,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-15 19:55:57,091 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-15 19:55:57,091 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:57,091 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:57,091 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-15 19:55:57,091 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:57,094 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,094 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,094 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:57,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:57,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:57,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:57,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:57,095 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:57,096 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:57,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:57,099 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:57,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-15 19:55:57,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:57,099 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-15 19:55:57,199 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:57,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:57,201 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:57,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:57,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:57,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:57,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:57,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-15 19:55:57,206 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-15 19:55:57,206 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:57,206 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-15 19:55:57,206 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-15 19:55:57,207 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,207 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:57,208 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,208 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:57,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:57,208 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:57,209 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:57,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:57,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-15 19:55:57,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-15 19:55:57,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-15 19:55:57,210 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-15 19:55:57,210 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:57,210 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-15 19:55:57,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:57,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. started... 2023-11-15 19:55:57,212 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:57,213 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:57,213 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b31c220251c7cd4674568bbe1cee203 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:57,212 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:57,213 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:57,213 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. started... 2023-11-15 19:55:57,213 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. started... 2023-11-15 19:55:57,213 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a1b7e9aa0f9b5a0f41ded90bdb3eefba 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:57,213 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1832f52a2a4870c6e6f331ad6393f6b3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-15 19:55:57,262 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111590fe52ca2c4d4e4fbd6d1dbc518f6ee9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111590fe52ca2c4d4e4fbd6d1dbc518f6ee9 2023-11-15 19:55:57,265 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115aa4fa2ccbfe446228e325a084f6309fa to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115aa4fa2ccbfe446228e325a084f6309fa 2023-11-15 19:55:57,277 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115c99978a1a06c476f8ffd28fda010f703 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231115c99978a1a06c476f8ffd28fda010f703 2023-11-15 19:55:57,677 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/751e2fa1ddd24b7b9b144b939d258d71 2023-11-15 19:55:57,679 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/1756ba0d99c842ec8409d97293ccebc1 2023-11-15 19:55:57,691 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/4bf68702a66f4c099e0fdc71b381c11b 2023-11-15 19:55:57,717 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115076c0b2fa9b44ad6bc01fc9bb72b31f5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231115076c0b2fa9b44ad6bc01fc9bb72b31f5 2023-11-15 19:55:57,720 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/723414b6e8eb41b4a0156b0151ff7b2c 2023-11-15 19:55:57,723 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/751e2fa1ddd24b7b9b144b939d258d71 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/751e2fa1ddd24b7b9b144b939d258d71 2023-11-15 19:55:57,733 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111556431ca1cddf46a799e2b68f339f689e to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111556431ca1cddf46a799e2b68f339f689e 2023-11-15 19:55:57,742 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/f49f3db9269a4ea1ac62aded8e456e62 2023-11-15 19:55:57,745 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/4bf68702a66f4c099e0fdc71b381c11b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/4bf68702a66f4c099e0fdc71b381c11b 2023-11-15 19:55:57,747 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/751e2fa1ddd24b7b9b144b939d258d71, entries=4, sequenceid=13, filesize=5.5 K 2023-11-15 19:55:57,748 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/723414b6e8eb41b4a0156b0151ff7b2c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/723414b6e8eb41b4a0156b0151ff7b2c 2023-11-15 19:55:57,751 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/723414b6e8eb41b4a0156b0151ff7b2c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:57,752 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a1b7e9aa0f9b5a0f41ded90bdb3eefba in 538ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:57,752 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:55:57,752 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:57,767 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/4bf68702a66f4c099e0fdc71b381c11b, entries=4, sequenceid=13, filesize=5.5 K 2023-11-15 19:55:57,768 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/f49f3db9269a4ea1ac62aded8e456e62 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/f49f3db9269a4ea1ac62aded8e456e62 2023-11-15 19:55:57,771 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/f49f3db9269a4ea1ac62aded8e456e62, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:57,772 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1832f52a2a4870c6e6f331ad6393f6b3 in 559ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:57,772 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:55:57,772 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:57,772 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:58,118 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311157afb0b262ad641f7a170ab1bc813ff73 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311157afb0b262ad641f7a170ab1bc813ff73 2023-11-15 19:55:58,139 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:55:58,139 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05995854 to 127.0.0.1:50885 2023-11-15 19:55:58,139 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:55:58,139 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:55:58,139 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2366f760 to 127.0.0.1:50885 2023-11-15 19:55:58,139 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:55:58,540 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/1818ac6b2c8342d898428bd232440a4b 2023-11-15 19:55:58,544 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/1756ba0d99c842ec8409d97293ccebc1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1756ba0d99c842ec8409d97293ccebc1 2023-11-15 19:55:58,568 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1756ba0d99c842ec8409d97293ccebc1, entries=4, sequenceid=13, filesize=5.5 K 2023-11-15 19:55:58,569 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/1818ac6b2c8342d898428bd232440a4b as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1818ac6b2c8342d898428bd232440a4b 2023-11-15 19:55:58,573 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1818ac6b2c8342d898428bd232440a4b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-15 19:55:58,573 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7b31c220251c7cd4674568bbe1cee203 in 1361ms, sequenceid=13, compaction requested=true 2023-11-15 19:55:58,573 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:55:58,573 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:58,573 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-15 19:55:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-15 19:55:58,575 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,575 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:58,576 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,576 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:58,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-15 19:55:58,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11cbeb00[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:58,577 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-15 19:55:58,577 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,579 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-15 19:55:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-15 19:55:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:58,579 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,579 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:58,580 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,580 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-15 19:55:58,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,580 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:58,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:58,580 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-15 19:55:58,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-15 19:55:58,582 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-15 19:55:58,583 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:58,583 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:58,583 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-15 19:55:58,583 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:58,585 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,585 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,585 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:58,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:58,586 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:58,587 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,589 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:58,589 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,589 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:58,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:58,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-15 19:55:58,589 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:58,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-15 19:55:58,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:58,589 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:58,589 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:58,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:58,590 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:58,590 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:58,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:58,590 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,690 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:58,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:58,692 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:58,692 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:58,692 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. with WAL disabled. Data may be lost in the event of a crash. 2023-11-15 19:55:58,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:58,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:58,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-15 19:55:58,697 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-15 19:55:58,697 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:58,697 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-15 19:55:58,697 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-15 19:55:58,697 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,697 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:58,698 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,698 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:58,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:58,699 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:58,699 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:58,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:58,700 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-15 19:55:58,700 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-15 19:55:58,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-15 19:55:58,700 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-15 19:55:58,700 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:58,700 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-15 19:55:58,701 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:58,701 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. started... 2023-11-15 19:55:58,701 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:58,701 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. started... 2023-11-15 19:55:58,701 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b31c220251c7cd4674568bbe1cee203 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:58,701 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a1b7e9aa0f9b5a0f41ded90bdb3eefba 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:58,701 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:58,701 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:58,701 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:58,701 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. started... 2023-11-15 19:55:58,701 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1832f52a2a4870c6e6f331ad6393f6b3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-15 19:55:58,736 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-15 19:55:58,761 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111575254531db15405683d128d4b5283556 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111575254531db15405683d128d4b5283556 2023-11-15 19:55:59,159 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111564b1b053b1b94edd995965fe253117ee to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111564b1b053b1b94edd995965fe253117ee 2023-11-15 19:55:59,161 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115b2320855c0bb47008c68e660446c87ec to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b2320855c0bb47008c68e660446c87ec 2023-11-15 19:55:59,180 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/bb209a62408840cd8e042fe0bda5b00d 2023-11-15 19:55:59,580 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/5ab23f500660426e92910afecf415272 2023-11-15 19:55:59,581 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/b1bd4efaa5c84ebbac1fbb1b719d8643 2023-11-15 19:55:59,610 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311153d12c40714014817a7e27acf3a5255c6 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311153d12c40714014817a7e27acf3a5255c6 2023-11-15 19:55:59,612 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111503f86c541eae480891d70d3ae98c39b3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023111503f86c541eae480891d70d3ae98c39b3 2023-11-15 19:55:59,614 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/dafa9e94e98e481db11e3f1b4c9519b5 2023-11-15 19:55:59,617 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/bb209a62408840cd8e042fe0bda5b00d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/bb209a62408840cd8e042fe0bda5b00d 2023-11-15 19:55:59,618 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/9f5b9a26f21d4e8ba660c58d6715283d 2023-11-15 19:55:59,625 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/b1bd4efaa5c84ebbac1fbb1b719d8643 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/b1bd4efaa5c84ebbac1fbb1b719d8643 2023-11-15 19:55:59,628 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311159722513c2c754f60b76560cc4cb83f05 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311159722513c2c754f60b76560cc4cb83f05 2023-11-15 19:55:59,639 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/2bd64c1f0cee4005878567721fb4ccdf 2023-11-15 19:55:59,643 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/bb209a62408840cd8e042fe0bda5b00d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-15 19:55:59,643 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/5ab23f500660426e92910afecf415272 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/5ab23f500660426e92910afecf415272 2023-11-15 19:55:59,643 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/dafa9e94e98e481db11e3f1b4c9519b5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/dafa9e94e98e481db11e3f1b4c9519b5 2023-11-15 19:55:59,649 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/dafa9e94e98e481db11e3f1b4c9519b5, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:59,650 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/b1bd4efaa5c84ebbac1fbb1b719d8643, entries=4, sequenceid=17, filesize=5.5 K 2023-11-15 19:55:59,650 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7b31c220251c7cd4674568bbe1cee203 in 949ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:59,650 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:55:59,650 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:59,650 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:55:59,650 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/9f5b9a26f21d4e8ba660c58d6715283d as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/9f5b9a26f21d4e8ba660c58d6715283d 2023-11-15 19:55:59,657 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/9f5b9a26f21d4e8ba660c58d6715283d, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:59,657 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a1b7e9aa0f9b5a0f41ded90bdb3eefba in 956ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:59,657 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:55:59,658 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:59,658 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:55:59,674 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/5ab23f500660426e92910afecf415272, entries=4, sequenceid=17, filesize=5.5 K 2023-11-15 19:55:59,675 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/2bd64c1f0cee4005878567721fb4ccdf as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/2bd64c1f0cee4005878567721fb4ccdf 2023-11-15 19:55:59,678 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/2bd64c1f0cee4005878567721fb4ccdf, entries=2, sequenceid=17, filesize=5.1 K 2023-11-15 19:55:59,679 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1832f52a2a4870c6e6f331ad6393f6b3 in 978ms, sequenceid=17, compaction requested=true 2023-11-15 19:55:59,679 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:55:59,679 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:59,679 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:55:59,679 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:55:59,679 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,679 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-15 19:55:59,679 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-15 19:55:59,681 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,681 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:59,681 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,682 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:55:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:59,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-15 19:55:59,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cd525f[Count = 0] remaining members to acquire global barrier 2023-11-15 19:55:59,683 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-15 19:55:59,683 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,688 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,688 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-15 19:55:59,688 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-15 19:55:59,688 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:55:59,688 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,688 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:55:59,690 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-15 19:55:59,690 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:59,690 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,690 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-15 19:55:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:59,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:59,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:59,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:59,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:59,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:55:59,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-15 19:55:59,692 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-15 19:55:59,693 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:55:59,693 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:55:59,693 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-15 19:55:59,693 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:55:59,694 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,694 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:55:59,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,695 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:55:59,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:59,695 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:55:59,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:59,697 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:55:59,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:55:59,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,699 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:59,699 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,699 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:55:59,699 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:55:59,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:59,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-15 19:55:59,699 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:59,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-15 19:55:59,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:55:59,700 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:59,700 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,700 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,700 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-15 19:55:59,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:55:59,700 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:55:59,700 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:55:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:55:59,700 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,800 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:55:59,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:55:59,809 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:59,815 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:59,822 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:55:59,822 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:55:59,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-15 19:55:59,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-15 19:55:59,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-15 19:55:59,909 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-15 19:55:59,909 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:59,909 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-15 19:55:59,909 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-15 19:55:59,910 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,910 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:59,913 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,913 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:55:59,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:55:59,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:55:59,913 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:55:59,913 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-15 19:55:59,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:59,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:55:59,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-15 19:55:59,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:55:59,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-15 19:55:59,914 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-15 19:55:59,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-15 19:55:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-15 19:55:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-15 19:55:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-15 19:55:59,915 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:55:59,915 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. started... 2023-11-15 19:55:59,915 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-15 19:55:59,915 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7b31c220251c7cd4674568bbe1cee203 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:59,915 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-15 19:55:59,915 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:55:59,915 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:55:59,915 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. started... 2023-11-15 19:55:59,915 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. started... 2023-11-15 19:55:59,915 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a1b7e9aa0f9b5a0f41ded90bdb3eefba 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:59,915 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1832f52a2a4870c6e6f331ad6393f6b3 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-15 19:55:59,956 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/890761d13c2a486e96857362731acea5 2023-11-15 19:55:59,960 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/89092eeb9adf4917819ff5609a7930ce 2023-11-15 19:55:59,987 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 890761d13c2a486e96857362731acea5 2023-11-15 19:55:59,990 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89092eeb9adf4917819ff5609a7930ce 2023-11-15 19:55:59,999 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/922849dacd5d45c8b040d939d90234df 2023-11-15 19:56:00,002 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 922849dacd5d45c8b040d939d90234df 2023-11-15 19:56:00,003 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/89092eeb9adf4917819ff5609a7930ce as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/89092eeb9adf4917819ff5609a7930ce 2023-11-15 19:56:00,024 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89092eeb9adf4917819ff5609a7930ce 2023-11-15 19:56:00,024 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/89092eeb9adf4917819ff5609a7930ce, entries=3, sequenceid=23, filesize=5.2 K 2023-11-15 19:56:00,025 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/922849dacd5d45c8b040d939d90234df as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/922849dacd5d45c8b040d939d90234df 2023-11-15 19:56:00,028 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 922849dacd5d45c8b040d939d90234df 2023-11-15 19:56:00,028 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/922849dacd5d45c8b040d939d90234df, entries=1, sequenceid=23, filesize=5.0 K 2023-11-15 19:56:00,028 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a1b7e9aa0f9b5a0f41ded90bdb3eefba in 113ms, sequenceid=23, compaction requested=true 2023-11-15 19:56:00,028 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:56:00,028 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:00,028 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-15 19:56:00,358 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/76603c60edc94ce5bb1b7ef2f40403f2 2023-11-15 19:56:00,381 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76603c60edc94ce5bb1b7ef2f40403f2 2023-11-15 19:56:00,401 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/c15c96412ef04282bf2f4122933877b5 2023-11-15 19:56:00,404 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c15c96412ef04282bf2f4122933877b5 2023-11-15 19:56:00,405 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/890761d13c2a486e96857362731acea5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/890761d13c2a486e96857362731acea5 2023-11-15 19:56:00,428 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 890761d13c2a486e96857362731acea5 2023-11-15 19:56:00,428 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/890761d13c2a486e96857362731acea5, entries=3, sequenceid=23, filesize=5.2 K 2023-11-15 19:56:00,429 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/c15c96412ef04282bf2f4122933877b5 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/c15c96412ef04282bf2f4122933877b5 2023-11-15 19:56:00,432 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c15c96412ef04282bf2f4122933877b5 2023-11-15 19:56:00,432 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/c15c96412ef04282bf2f4122933877b5, entries=1, sequenceid=23, filesize=5.0 K 2023-11-15 19:56:00,433 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7b31c220251c7cd4674568bbe1cee203 in 518ms, sequenceid=23, compaction requested=true 2023-11-15 19:56:00,433 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:56:00,433 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-15 19:56:00,801 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/9ff738ebf2fe47d0bb10a022c2c8d646 2023-11-15 19:56:00,804 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ff738ebf2fe47d0bb10a022c2c8d646 2023-11-15 19:56:00,805 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/76603c60edc94ce5bb1b7ef2f40403f2 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/76603c60edc94ce5bb1b7ef2f40403f2 2023-11-15 19:56:00,827 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76603c60edc94ce5bb1b7ef2f40403f2 2023-11-15 19:56:00,827 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/76603c60edc94ce5bb1b7ef2f40403f2, entries=3, sequenceid=23, filesize=5.2 K 2023-11-15 19:56:00,827 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/9ff738ebf2fe47d0bb10a022c2c8d646 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/9ff738ebf2fe47d0bb10a022c2c8d646 2023-11-15 19:56:00,830 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ff738ebf2fe47d0bb10a022c2c8d646 2023-11-15 19:56:00,831 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/9ff738ebf2fe47d0bb10a022c2c8d646, entries=1, sequenceid=23, filesize=5.0 K 2023-11-15 19:56:00,831 INFO [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1832f52a2a4870c6e6f331ad6393f6b3 in 916ms, sequenceid=23, compaction requested=true 2023-11-15 19:56:00,831 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:56:00,831 DEBUG [rs(jenkins-hbase4.apache.org,42249,1700078002491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:00,831 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-15 19:56:00,831 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-15 19:56:00,831 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,831 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-15 19:56:00,832 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-15 19:56:00,833 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,833 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:56:00,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:56:00,834 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,834 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-15 19:56:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:56:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:56:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:56:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:56:00,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42249,1700078002491' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-15 19:56:00,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@273b5368[Count = 0] remaining members to acquire global barrier 2023-11-15 19:56:00,835 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-15 19:56:00,835 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,836 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-15 19:56:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-15 19:56:00,836 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,836 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-15 19:56:00,836 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42249,1700078002491' in zk 2023-11-15 19:56:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-15 19:56:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:56:00,838 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,42249,1700078002491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-15 19:56:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:56:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:56:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:56:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:56:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:56:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:56:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:56:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42249,1700078002491': 2023-11-15 19:56:00,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42249,1700078002491' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-15 19:56:00,840 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-15 19:56:00,841 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-15 19:56:00,841 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-15 19:56:00,841 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-15 19:56:00,841 INFO [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-15 19:56:00,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:56:00,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:56:00,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:56:00,843 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:56:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:56:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:56:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-15 19:56:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-15 19:56:00,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:56:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:56:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-15 19:56:00,844 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:56:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:56:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-15 19:56:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:56:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,846 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-15 19:56:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-15 19:56:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,848 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,848 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-15 19:56:00,848 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:56:00,848 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-15 19:56:00,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-15 19:56:00,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-15 19:56:00,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-15 19:56:00,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-15 19:56:00,848 DEBUG [(jenkins-hbase4.apache.org,38755,1700078001267)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-15 19:56:00,848 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-15 19:56:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-15 19:56:00,849 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-15 19:56:00,849 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-15 19:56:00,849 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:00,849 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-15 19:56:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-15 19:56:00,849 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-15 19:56:00,849 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-15 19:56:00,949 DEBUG [Listener at localhost/43577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-15 19:56:00,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-15 19:56:00,950 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:56:00,950 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 7b31c220251c7cd4674568bbe1cee203/family1 is initiating major compaction (all files) 2023-11-15 19:56:00,951 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:56:00,951 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:56:00,951 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 7b31c220251c7cd4674568bbe1cee203/family1 in testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:00,952 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/f085837d1b9d41d6bbb8534ef70471c4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1f856c3e69ff43909f8d3055b1a60b34, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1756ba0d99c842ec8409d97293ccebc1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/bb209a62408840cd8e042fe0bda5b00d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/890761d13c2a486e96857362731acea5] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp, totalSize=27.1 K 2023-11-15 19:56:00,952 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting f085837d1b9d41d6bbb8534ef70471c4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078154204 2023-11-15 19:56:00,952 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 1f856c3e69ff43909f8d3055b1a60b34, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078155714 2023-11-15 19:56:00,953 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 1756ba0d99c842ec8409d97293ccebc1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078157202 2023-11-15 19:56:00,953 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting bb209a62408840cd8e042fe0bda5b00d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078158692 2023-11-15 19:56:00,953 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 890761d13c2a486e96857362731acea5, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:56:00,962 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 7b31c220251c7cd4674568bbe1cee203#family1#compaction#196 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:56:01,399 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231115771fca4fc67a48b4bc76f9a9b15d094d_del 2023-11-15 19:56:01,399 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115771fca4fc67a48b4bc76f9a9b15d094d_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115771fca4fc67a48b4bc76f9a9b15d094d_del 2023-11-15 19:56:01,849 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9ec8003179468781debb553371c853 2023-11-15 19:56:01,850 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family1/de9ec8003179468781debb553371c853 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/de9ec8003179468781debb553371c853 2023-11-15 19:56:01,872 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9ec8003179468781debb553371c853 2023-11-15 19:56:01,872 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b31c220251c7cd4674568bbe1cee203/family1 of 7b31c220251c7cd4674568bbe1cee203 into de9ec8003179468781debb553371c853(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:56:01,873 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:56:01,873 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:56:01,873 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 7b31c220251c7cd4674568bbe1cee203/family2 is initiating major compaction (all files) 2023-11-15 19:56:01,873 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:56:01,873 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:56:01,874 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 7b31c220251c7cd4674568bbe1cee203/family2 in testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:01,875 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1ccca77175914cf398ddfd3ea8222866, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/6dcf9032c85e40d2bb38977a4f8b5ca7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1818ac6b2c8342d898428bd232440a4b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/dafa9e94e98e481db11e3f1b4c9519b5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/c15c96412ef04282bf2f4122933877b5] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp, totalSize=25.4 K 2023-11-15 19:56:01,875 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 1ccca77175914cf398ddfd3ea8222866, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078154204 2023-11-15 19:56:01,875 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 6dcf9032c85e40d2bb38977a4f8b5ca7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078155714 2023-11-15 19:56:01,876 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 1818ac6b2c8342d898428bd232440a4b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078157202 2023-11-15 19:56:01,876 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting dafa9e94e98e481db11e3f1b4c9519b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078158692 2023-11-15 19:56:01,876 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting c15c96412ef04282bf2f4122933877b5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:56:01,884 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 7b31c220251c7cd4674568bbe1cee203#family2#compaction#197 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:56:01,890 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111530dbb1c99b8d484495b93ca6f7751280_del 2023-11-15 19:56:01,890 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111530dbb1c99b8d484495b93ca6f7751280_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023111530dbb1c99b8d484495b93ca6f7751280_del 2023-11-15 19:56:01,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/f085837d1b9d41d6bbb8534ef70471c4, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1f856c3e69ff43909f8d3055b1a60b34, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1756ba0d99c842ec8409d97293ccebc1, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/bb209a62408840cd8e042fe0bda5b00d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/890761d13c2a486e96857362731acea5] to archive 2023-11-15 19:56:01,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:01,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/f085837d1b9d41d6bbb8534ef70471c4 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/f085837d1b9d41d6bbb8534ef70471c4 2023-11-15 19:56:01,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1f856c3e69ff43909f8d3055b1a60b34 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1f856c3e69ff43909f8d3055b1a60b34 2023-11-15 19:56:01,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1756ba0d99c842ec8409d97293ccebc1 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/1756ba0d99c842ec8409d97293ccebc1 2023-11-15 19:56:01,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/bb209a62408840cd8e042fe0bda5b00d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/bb209a62408840cd8e042fe0bda5b00d 2023-11-15 19:56:01,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/890761d13c2a486e96857362731acea5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/890761d13c2a486e96857362731acea5 2023-11-15 19:56:02,702 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd91f5c1607d4211888dcb82d6f40321 2023-11-15 19:56:02,703 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/.tmp/family2/cd91f5c1607d4211888dcb82d6f40321 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/cd91f5c1607d4211888dcb82d6f40321 2023-11-15 19:56:02,706 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd91f5c1607d4211888dcb82d6f40321 2023-11-15 19:56:02,707 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b31c220251c7cd4674568bbe1cee203/family2 of 7b31c220251c7cd4674568bbe1cee203 into cd91f5c1607d4211888dcb82d6f40321(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:56:02,707 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:56:02,707 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:56:02,707 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 is initiating major compaction (all files) 2023-11-15 19:56:02,708 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:56:02,708 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:56:02,708 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 in testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:02,708 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/be1976e07a3f4b8da3a14375be8eb2ea, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/a05ba42e5f7d423c89791bfd725837fc, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/751e2fa1ddd24b7b9b144b939d258d71, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/b1bd4efaa5c84ebbac1fbb1b719d8643, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/89092eeb9adf4917819ff5609a7930ce] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp, totalSize=27.1 K 2023-11-15 19:56:02,708 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting be1976e07a3f4b8da3a14375be8eb2ea, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078154204 2023-11-15 19:56:02,709 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting a05ba42e5f7d423c89791bfd725837fc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078155714 2023-11-15 19:56:02,709 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 751e2fa1ddd24b7b9b144b939d258d71, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078157201 2023-11-15 19:56:02,709 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting b1bd4efaa5c84ebbac1fbb1b719d8643, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078158692 2023-11-15 19:56:02,710 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 89092eeb9adf4917819ff5609a7930ce, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:56:02,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1ccca77175914cf398ddfd3ea8222866, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/6dcf9032c85e40d2bb38977a4f8b5ca7, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1818ac6b2c8342d898428bd232440a4b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/dafa9e94e98e481db11e3f1b4c9519b5, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/c15c96412ef04282bf2f4122933877b5] to archive 2023-11-15 19:56:02,717 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): a1b7e9aa0f9b5a0f41ded90bdb3eefba#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:56:02,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:02,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1ccca77175914cf398ddfd3ea8222866 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1ccca77175914cf398ddfd3ea8222866 2023-11-15 19:56:02,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/6dcf9032c85e40d2bb38977a4f8b5ca7 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/6dcf9032c85e40d2bb38977a4f8b5ca7 2023-11-15 19:56:02,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1818ac6b2c8342d898428bd232440a4b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/1818ac6b2c8342d898428bd232440a4b 2023-11-15 19:56:02,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/dafa9e94e98e481db11e3f1b4c9519b5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/dafa9e94e98e481db11e3f1b4c9519b5 2023-11-15 19:56:02,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/c15c96412ef04282bf2f4122933877b5 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family2/c15c96412ef04282bf2f4122933877b5 2023-11-15 19:56:03,157 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231115cebeab2c75414460a8af58d5c2ba0476_del 2023-11-15 19:56:03,157 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231115cebeab2c75414460a8af58d5c2ba0476_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115cebeab2c75414460a8af58d5c2ba0476_del 2023-11-15 19:56:03,618 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e12b808526dc45139c0aac51d6edcdc1 2023-11-15 19:56:03,619 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family1/e12b808526dc45139c0aac51d6edcdc1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/e12b808526dc45139c0aac51d6edcdc1 2023-11-15 19:56:03,651 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e12b808526dc45139c0aac51d6edcdc1 2023-11-15 19:56:03,652 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 of a1b7e9aa0f9b5a0f41ded90bdb3eefba into e12b808526dc45139c0aac51d6edcdc1(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:56:03,652 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:56:03,652 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:56:03,652 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2 is initiating major compaction (all files) 2023-11-15 19:56:03,653 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:56:03,653 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:56:03,653 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2 in testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:03,653 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/cec2ee1c63b640e889eab959fa47b400, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/506e00d0df95487dbf7164faec0c5b91, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/723414b6e8eb41b4a0156b0151ff7b2c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/9f5b9a26f21d4e8ba660c58d6715283d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/922849dacd5d45c8b040d939d90234df] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp, totalSize=25.4 K 2023-11-15 19:56:03,654 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting cec2ee1c63b640e889eab959fa47b400, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078154204 2023-11-15 19:56:03,654 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 506e00d0df95487dbf7164faec0c5b91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078155714 2023-11-15 19:56:03,654 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 723414b6e8eb41b4a0156b0151ff7b2c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078157201 2023-11-15 19:56:03,655 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 9f5b9a26f21d4e8ba660c58d6715283d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078158692 2023-11-15 19:56:03,655 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 922849dacd5d45c8b040d939d90234df, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:56:03,663 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): a1b7e9aa0f9b5a0f41ded90bdb3eefba#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:56:03,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/be1976e07a3f4b8da3a14375be8eb2ea, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/a05ba42e5f7d423c89791bfd725837fc, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/751e2fa1ddd24b7b9b144b939d258d71, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/b1bd4efaa5c84ebbac1fbb1b719d8643, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/89092eeb9adf4917819ff5609a7930ce] to archive 2023-11-15 19:56:03,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:03,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/be1976e07a3f4b8da3a14375be8eb2ea to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/be1976e07a3f4b8da3a14375be8eb2ea 2023-11-15 19:56:03,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/a05ba42e5f7d423c89791bfd725837fc to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/a05ba42e5f7d423c89791bfd725837fc 2023-11-15 19:56:03,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/751e2fa1ddd24b7b9b144b939d258d71 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/751e2fa1ddd24b7b9b144b939d258d71 2023-11-15 19:56:03,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/b1bd4efaa5c84ebbac1fbb1b719d8643 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/b1bd4efaa5c84ebbac1fbb1b719d8643 2023-11-15 19:56:03,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/89092eeb9adf4917819ff5609a7930ce to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/89092eeb9adf4917819ff5609a7930ce 2023-11-15 19:56:04,070 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111523cc06115a9043ec8d36c6c2adac64f4_del 2023-11-15 19:56:04,070 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111523cc06115a9043ec8d36c6c2adac64f4_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023111523cc06115a9043ec8d36c6c2adac64f4_del 2023-11-15 19:56:04,482 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fbfea2461cb4263b921e5bb42464a99 2023-11-15 19:56:04,482 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/.tmp/family2/7fbfea2461cb4263b921e5bb42464a99 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/7fbfea2461cb4263b921e5bb42464a99 2023-11-15 19:56:04,486 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fbfea2461cb4263b921e5bb42464a99 2023-11-15 19:56:04,487 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2 of a1b7e9aa0f9b5a0f41ded90bdb3eefba into 7fbfea2461cb4263b921e5bb42464a99(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:56:04,487 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:56:04,487 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:56:04,487 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 1832f52a2a4870c6e6f331ad6393f6b3/family1 is initiating major compaction (all files) 2023-11-15 19:56:04,487 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:56:04,487 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:56:04,488 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 1832f52a2a4870c6e6f331ad6393f6b3/family1 in testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:04,488 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/ffce256ab6eb4f0e8a3241e9834dcb1f, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1f9a6c09644249189c7f12d517ad0f59, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/4bf68702a66f4c099e0fdc71b381c11b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/5ab23f500660426e92910afecf415272, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/76603c60edc94ce5bb1b7ef2f40403f2] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp, totalSize=27.1 K 2023-11-15 19:56:04,488 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting ffce256ab6eb4f0e8a3241e9834dcb1f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078154204 2023-11-15 19:56:04,488 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 1f9a6c09644249189c7f12d517ad0f59, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078155714 2023-11-15 19:56:04,489 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 4bf68702a66f4c099e0fdc71b381c11b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078157202 2023-11-15 19:56:04,489 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 5ab23f500660426e92910afecf415272, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078158692 2023-11-15 19:56:04,489 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 76603c60edc94ce5bb1b7ef2f40403f2, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:56:04,498 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 1832f52a2a4870c6e6f331ad6393f6b3#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:56:04,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/cec2ee1c63b640e889eab959fa47b400, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/506e00d0df95487dbf7164faec0c5b91, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/723414b6e8eb41b4a0156b0151ff7b2c, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/9f5b9a26f21d4e8ba660c58d6715283d, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/922849dacd5d45c8b040d939d90234df] to archive 2023-11-15 19:56:04,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:04,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/cec2ee1c63b640e889eab959fa47b400 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/cec2ee1c63b640e889eab959fa47b400 2023-11-15 19:56:04,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/506e00d0df95487dbf7164faec0c5b91 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/506e00d0df95487dbf7164faec0c5b91 2023-11-15 19:56:04,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/723414b6e8eb41b4a0156b0151ff7b2c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/723414b6e8eb41b4a0156b0151ff7b2c 2023-11-15 19:56:04,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/9f5b9a26f21d4e8ba660c58d6715283d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/9f5b9a26f21d4e8ba660c58d6715283d 2023-11-15 19:56:04,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/922849dacd5d45c8b040d939d90234df to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family2/922849dacd5d45c8b040d939d90234df 2023-11-15 19:56:04,936 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111594df7f767339464f9efd0be7988171e2_del 2023-11-15 19:56:04,936 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111594df7f767339464f9efd0be7988171e2_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111594df7f767339464f9efd0be7988171e2_del 2023-11-15 19:56:05,787 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 334bf65e9e604cec9ebf4ece45e860da 2023-11-15 19:56:05,788 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family1/334bf65e9e604cec9ebf4ece45e860da as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/334bf65e9e604cec9ebf4ece45e860da 2023-11-15 19:56:05,810 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 334bf65e9e604cec9ebf4ece45e860da 2023-11-15 19:56:05,811 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1832f52a2a4870c6e6f331ad6393f6b3/family1 of 1832f52a2a4870c6e6f331ad6393f6b3 into 334bf65e9e604cec9ebf4ece45e860da(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-15 19:56:05,811 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:56:05,811 DEBUG [Listener at localhost/43577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-15 19:56:05,811 DEBUG [Listener at localhost/43577] regionserver.HStore(1912): 1832f52a2a4870c6e6f331ad6393f6b3/family2 is initiating major compaction (all files) 2023-11-15 19:56:05,811 INFO [Listener at localhost/43577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-15 19:56:05,811 INFO [Listener at localhost/43577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-15 19:56:05,812 INFO [Listener at localhost/43577] regionserver.HRegion(2259): Starting compaction of 1832f52a2a4870c6e6f331ad6393f6b3/family2 in testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:05,812 INFO [Listener at localhost/43577] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/ae40dbc7dc9048d393b7f526a7fcd5d3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/e66b7a2d0d8c4642837566b082105401, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/f49f3db9269a4ea1ac62aded8e456e62, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/2bd64c1f0cee4005878567721fb4ccdf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/9ff738ebf2fe47d0bb10a022c2c8d646] into tmpdir=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp, totalSize=25.4 K 2023-11-15 19:56:05,812 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting ae40dbc7dc9048d393b7f526a7fcd5d3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700078154204 2023-11-15 19:56:05,812 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting e66b7a2d0d8c4642837566b082105401, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700078155714 2023-11-15 19:56:05,813 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting f49f3db9269a4ea1ac62aded8e456e62, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700078157202 2023-11-15 19:56:05,813 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 2bd64c1f0cee4005878567721fb4ccdf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700078158692 2023-11-15 19:56:05,814 DEBUG [Listener at localhost/43577] compactions.Compactor(207): Compacting 9ff738ebf2fe47d0bb10a022c2c8d646, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-15 19:56:05,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/ffce256ab6eb4f0e8a3241e9834dcb1f, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1f9a6c09644249189c7f12d517ad0f59, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/4bf68702a66f4c099e0fdc71b381c11b, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/5ab23f500660426e92910afecf415272, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/76603c60edc94ce5bb1b7ef2f40403f2] to archive 2023-11-15 19:56:05,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:05,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/ffce256ab6eb4f0e8a3241e9834dcb1f to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/ffce256ab6eb4f0e8a3241e9834dcb1f 2023-11-15 19:56:05,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1f9a6c09644249189c7f12d517ad0f59 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1f9a6c09644249189c7f12d517ad0f59 2023-11-15 19:56:05,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/4bf68702a66f4c099e0fdc71b381c11b to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/4bf68702a66f4c099e0fdc71b381c11b 2023-11-15 19:56:05,822 INFO [Listener at localhost/43577] throttle.PressureAwareThroughputController(145): 1832f52a2a4870c6e6f331ad6393f6b3#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-15 19:56:05,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/5ab23f500660426e92910afecf415272 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/5ab23f500660426e92910afecf415272 2023-11-15 19:56:05,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/76603c60edc94ce5bb1b7ef2f40403f2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/76603c60edc94ce5bb1b7ef2f40403f2 2023-11-15 19:56:05,828 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311158e463e36512e43279cab8d55b741fe95_del 2023-11-15 19:56:05,829 INFO [Listener at localhost/43577] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311158e463e36512e43279cab8d55b741fe95_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311158e463e36512e43279cab8d55b741fe95_del 2023-11-15 19:56:06,239 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4557b54f8bb74b72974f7ed97a2efea6 2023-11-15 19:56:06,240 DEBUG [Listener at localhost/43577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/.tmp/family2/4557b54f8bb74b72974f7ed97a2efea6 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/4557b54f8bb74b72974f7ed97a2efea6 2023-11-15 19:56:06,244 INFO [Listener at localhost/43577] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4557b54f8bb74b72974f7ed97a2efea6 2023-11-15 19:56:06,244 INFO [Listener at localhost/43577] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1832f52a2a4870c6e6f331ad6393f6b3/family2 of 1832f52a2a4870c6e6f331ad6393f6b3 into 4557b54f8bb74b72974f7ed97a2efea6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-15 19:56:06,245 DEBUG [Listener at localhost/43577] regionserver.HRegion(2289): Compaction status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:56:06,248 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:56:06,251 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:56:06,255 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:56:06,255 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:56:06,260 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38755] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFD\x04\xE1\xD5\x81\xFD\xD7 \x11*\x821Lp>\xB7"\x10\xF7\xE9}j\x8D\x9C\x1Am5]\x11\xAE\x8C\x80`\x1B*\x106`u\xF6\xD4J\x94\xF5\x9D'\xA9Im\xD3\xF7t2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-15 19:56:06,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-15 19:56:06,282 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-15 19:56:06,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:56:06,282 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700078766282 2023-11-15 19:56:06,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-15 19:56:06,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/ae40dbc7dc9048d393b7f526a7fcd5d3, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/e66b7a2d0d8c4642837566b082105401, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/f49f3db9269a4ea1ac62aded8e456e62, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/2bd64c1f0cee4005878567721fb4ccdf, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/9ff738ebf2fe47d0bb10a022c2c8d646] to archive 2023-11-15 19:56:06,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:06,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/ae40dbc7dc9048d393b7f526a7fcd5d3 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/ae40dbc7dc9048d393b7f526a7fcd5d3 2023-11-15 19:56:06,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/e66b7a2d0d8c4642837566b082105401 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/e66b7a2d0d8c4642837566b082105401 2023-11-15 19:56:06,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/f49f3db9269a4ea1ac62aded8e456e62 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/f49f3db9269a4ea1ac62aded8e456e62 2023-11-15 19:56:06,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/2bd64c1f0cee4005878567721fb4ccdf to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/2bd64c1f0cee4005878567721fb4ccdf 2023-11-15 19:56:06,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/9ff738ebf2fe47d0bb10a022c2c8d646 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family2/9ff738ebf2fe47d0bb10a022c2c8d646 2023-11-15 19:56:06,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-15 19:56:06,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231115cebeab2c75414460a8af58d5c2ba0476_del 2023-11-15 19:56:06,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111594df7f767339464f9efd0be7988171e2_del 2023-11-15 19:56:06,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231115771fca4fc67a48b4bc76f9a9b15d094d_del 2023-11-15 19:56:06,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:06,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] zookeeper.ReadOnlyZKClient(139): Connect 0x064052b8 to 127.0.0.1:50885 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-15 19:56:06,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ec1ebc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-15 19:56:06,653 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231115 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-15 19:56:07,615 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231115dd77bd1ea2374a12b9086f11b568191d to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231115dd77bd1ea2374a12b9086f11b568191d 2023-11-15 19:56:07,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:07,627 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-15 19:56:07,629 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-15 19:56:07,637 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-15 19:56:07,639 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-15 19:56:07,666 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231115/family1/f97eb5214b794ae4a9df038a3bf62c7c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-15 19:56:07,666 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231115/family1/f97eb5214b794ae4a9df038a3bf62c7c}] 2023-11-15 19:56:07,670 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231115/family1/f97eb5214b794ae4a9df038a3bf62c7c for inclusion in 1832f52a2a4870c6e6f331ad6393f6b3/family1 2023-11-15 19:56:07,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-15 19:56:07,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-15 19:56:07,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:56:07,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231115/family1/f97eb5214b794ae4a9df038a3bf62c7c to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__urnvus30dgj99i9l1rfvu9j39qui00b10nl5umlun10t1l7msug6oe630lkomohi/family1/f97eb5214b794ae4a9df038a3bf62c7c 2023-11-15 19:56:07,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__urnvus30dgj99i9l1rfvu9j39qui00b10nl5umlun10t1l7msug6oe630lkomohi/family1/f97eb5214b794ae4a9df038a3bf62c7c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1edeffcaafcd426eb64328648c9cd191_SeqId_28_ 2023-11-15 19:56:07,693 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__urnvus30dgj99i9l1rfvu9j39qui00b10nl5umlun10t1l7msug6oe630lkomohi/family1/f97eb5214b794ae4a9df038a3bf62c7c into 1832f52a2a4870c6e6f331ad6393f6b3/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1edeffcaafcd426eb64328648c9cd191_SeqId_28_ - updating store file list. 2023-11-15 19:56:07,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1edeffcaafcd426eb64328648c9cd191_SeqId_28_ into 1832f52a2a4870c6e6f331ad6393f6b3/family1 2023-11-15 19:56:07,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__urnvus30dgj99i9l1rfvu9j39qui00b10nl5umlun10t1l7msug6oe630lkomohi/family1/f97eb5214b794ae4a9df038a3bf62c7c into 1832f52a2a4870c6e6f331ad6393f6b3/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/family1/1edeffcaafcd426eb64328648c9cd191_SeqId_28_) 2023-11-15 19:56:07,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__urnvus30dgj99i9l1rfvu9j39qui00b10nl5umlun10t1l7msug6oe630lkomohi/family1/f97eb5214b794ae4a9df038a3bf62c7c 2023-11-15 19:56:07,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231115 table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:07,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:07,720 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231115033a4b9194644b44bb2ed1cc9a625ccd to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231115033a4b9194644b44bb2ed1cc9a625ccd 2023-11-15 19:56:07,721 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111511c9f95affb74e60ae0c685801a05e91 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111511c9f95affb74e60ae0c685801a05e91 2023-11-15 19:56:07,722 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111564b1b053b1b94edd995965fe253117ee to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111564b1b053b1b94edd995965fe253117ee 2023-11-15 19:56:07,723 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231115c99978a1a06c476f8ffd28fda010f703 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231115c99978a1a06c476f8ffd28fda010f703 2023-11-15 19:56:07,723 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-15 19:56:07,723 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231115' 2023-11-15 19:56:07,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231115 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-15 19:56:07,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231115 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-15 19:56:08,668 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231115ffa7d38026244934b590e0aac4518652 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115ffa7d38026244934b590e0aac4518652 2023-11-15 19:56:08,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:08,709 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231115/family1/836c85ab1da640488033688d11cc1703 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-15 19:56:08,710 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231115/family1/836c85ab1da640488033688d11cc1703}] 2023-11-15 19:56:08,712 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231115/family1/836c85ab1da640488033688d11cc1703 for inclusion in 7b31c220251c7cd4674568bbe1cee203/family1 2023-11-15 19:56:08,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-15 19:56:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-15 19:56:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:56:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231115/family1/836c85ab1da640488033688d11cc1703 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__55gpq5upo4tm8pta1q6sojtag2n8d2932cmn20ev6noljn0fhp73gdl1aljt731f/family1/836c85ab1da640488033688d11cc1703 2023-11-15 19:56:08,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__55gpq5upo4tm8pta1q6sojtag2n8d2932cmn20ev6noljn0fhp73gdl1aljt731f/family1/836c85ab1da640488033688d11cc1703 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/37313c14ee8348049a497cd0e78d1fcf_SeqId_28_ 2023-11-15 19:56:08,735 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__55gpq5upo4tm8pta1q6sojtag2n8d2932cmn20ev6noljn0fhp73gdl1aljt731f/family1/836c85ab1da640488033688d11cc1703 into 7b31c220251c7cd4674568bbe1cee203/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/37313c14ee8348049a497cd0e78d1fcf_SeqId_28_ - updating store file list. 2023-11-15 19:56:08,755 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/37313c14ee8348049a497cd0e78d1fcf_SeqId_28_ into 7b31c220251c7cd4674568bbe1cee203/family1 2023-11-15 19:56:08,755 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__55gpq5upo4tm8pta1q6sojtag2n8d2932cmn20ev6noljn0fhp73gdl1aljt731f/family1/836c85ab1da640488033688d11cc1703 into 7b31c220251c7cd4674568bbe1cee203/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/family1/37313c14ee8348049a497cd0e78d1fcf_SeqId_28_) 2023-11-15 19:56:08,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__55gpq5upo4tm8pta1q6sojtag2n8d2932cmn20ev6noljn0fhp73gdl1aljt731f/family1/836c85ab1da640488033688d11cc1703 2023-11-15 19:56:08,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231115 table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:08,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:08,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311150fa4d03e8e2f4403ab7051f8d00a9296 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311150fa4d03e8e2f4403ab7051f8d00a9296 2023-11-15 19:56:08,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111530e2185d1d7a440881d9b63eba3d59b2 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111530e2185d1d7a440881d9b63eba3d59b2 2023-11-15 19:56:08,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111575254531db15405683d128d4b5283556 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111575254531db15405683d128d4b5283556 2023-11-15 19:56:08,761 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115aa4fa2ccbfe446228e325a084f6309fa to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115aa4fa2ccbfe446228e325a084f6309fa 2023-11-15 19:56:08,761 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-15 19:56:08,761 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231115' 2023-11-15 19:56:08,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231115 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-15 19:56:08,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231115 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-15 19:56:09,312 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311152256efe4fbec4d429bbd1032a8080776 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311152256efe4fbec4d429bbd1032a8080776 2023-11-15 19:56:09,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:09,350 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231115/family1/4652fde0a2b84372bea627e100d75d52 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-15 19:56:09,351 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba., hostname=jenkins-hbase4.apache.org,42249,1700078002491, seqNum=2 for row with hfile group [{family1,hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231115/family1/4652fde0a2b84372bea627e100d75d52}] 2023-11-15 19:56:09,353 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(763): Validating hfile at hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231115/family1/4652fde0a2b84372bea627e100d75d52 for inclusion in a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 2023-11-15 19:56:09,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-15 19:56:09,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(777): Region bounds: first= last=1 2023-11-15 19:56:09,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegion(2446): Flush status journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:56:09,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231115/family1/4652fde0a2b84372bea627e100d75d52 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__o03aa547r9poh5bnieejhhs4imn5t02dqbtf9b48g7qhvbh2p38fff69mbh1gged/family1/4652fde0a2b84372bea627e100d75d52 2023-11-15 19:56:09,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__o03aa547r9poh5bnieejhhs4imn5t02dqbtf9b48g7qhvbh2p38fff69mbh1gged/family1/4652fde0a2b84372bea627e100d75d52 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/41bdc8c4da09479d86c23d45f61ad83c_SeqId_28_ 2023-11-15 19:56:09,376 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(849): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__o03aa547r9poh5bnieejhhs4imn5t02dqbtf9b48g7qhvbh2p38fff69mbh1gged/family1/4652fde0a2b84372bea627e100d75d52 into a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/41bdc8c4da09479d86c23d45f61ad83c_SeqId_28_ - updating store file list. 2023-11-15 19:56:09,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(882): Loaded HFile hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/41bdc8c4da09479d86c23d45f61ad83c_SeqId_28_ into a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 2023-11-15 19:56:09,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.HStore(855): Successfully loaded hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__o03aa547r9poh5bnieejhhs4imn5t02dqbtf9b48g7qhvbh2p38fff69mbh1gged/family1/4652fde0a2b84372bea627e100d75d52 into a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1 (new location: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/family1/41bdc8c4da09479d86c23d45f61ad83c_SeqId_28_) 2023-11-15 19:56:09,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42249] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/staging/jenkins__testMajorCompactionFromAdmin__o03aa547r9poh5bnieejhhs4imn5t02dqbtf9b48g7qhvbh2p38fff69mbh1gged/family1/4652fde0a2b84372bea627e100d75d52 2023-11-15 19:56:09,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231115 table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:09,400 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:09,401 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111590fe52ca2c4d4e4fbd6d1dbc518f6ee9 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111590fe52ca2c4d4e4fbd6d1dbc518f6ee9 2023-11-15 19:56:09,402 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b2320855c0bb47008c68e660446c87ec to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b2320855c0bb47008c68e660446c87ec 2023-11-15 19:56:09,403 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b3fcbff5e9684be4be82fe2473aa62fe to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b3fcbff5e9684be4be82fe2473aa62fe 2023-11-15 19:56:09,404 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b512ce6ad50149ba87fc1f3abee79b94 to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115b512ce6ad50149ba87fc1f3abee79b94 2023-11-15 19:56:09,404 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-15 19:56:09,404 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231115' 2023-11-15 19:56:09,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231115 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-15 19:56:09,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-15 19:56:09,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-15 19:56:09,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115cebeab2c75414460a8af58d5c2ba0476_del] 2023-11-15 19:56:09,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:09,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115cebeab2c75414460a8af58d5c2ba0476_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231115cebeab2c75414460a8af58d5c2ba0476_del 2023-11-15 19:56:09,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-15 19:56:09,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111594df7f767339464f9efd0be7988171e2_del] 2023-11-15 19:56:09,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:09,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111594df7f767339464f9efd0be7988171e2_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111594df7f767339464f9efd0be7988171e2_del 2023-11-15 19:56:09,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-15 19:56:09,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] compactions.PartitionedMobCompactor(367): [hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115771fca4fc67a48b4bc76f9a9b15d094d_del] 2023-11-15 19:56:09,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] backup.HFileArchiver(360): Archiving compacted files. 2023-11-15 19:56:09,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115771fca4fc67a48b4bc76f9a9b15d094d_del to hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231115771fca4fc67a48b4bc76f9a9b15d094d_del 2023-11-15 19:56:09,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-15 19:56:09,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700078006199] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-15 19:56:09,410 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-15 19:56:09,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.1300 sec 2023-11-15 19:56:09,432 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:56:09,434 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:56:09,437 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-15 19:56:09,437 DEBUG [Listener at localhost/43577] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-15 19:56:09,442 INFO [Listener at localhost/43577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-15 19:56:09,477 INFO [Listener at localhost/43577] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=251 (was 269), OpenFileDescriptor=685 (was 695), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 143), ProcessCount=168 (was 169), AvailableMemoryMB=1236 (was 1243) 2023-11-15 19:56:09,478 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a11c17b to 127.0.0.1:50885 2023-11-15 19:56:09,478 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:56:09,478 INFO [Listener at localhost/43577] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-15 19:56:09,478 INFO [Listener at localhost/43577] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-15 19:56:09,478 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77fd41f4 to 127.0.0.1:50885 2023-11-15 19:56:09,478 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:56:09,479 DEBUG [Listener at localhost/43577] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-15 19:56:09,479 DEBUG [Listener at localhost/43577] util.JVMClusterUtil(257): Found active master hash=1717603341, stopped=false 2023-11-15 19:56:09,479 INFO [Listener at localhost/43577] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:56:09,481 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-15 19:56:09,481 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-15 19:56:09,481 INFO [Listener at localhost/43577] procedure2.ProcedureExecutor(628): Stopping 2023-11-15 19:56:09,481 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:56:09,481 DEBUG [Listener at localhost/43577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d96b69b to 127.0.0.1:50885 2023-11-15 19:56:09,481 DEBUG [Listener at localhost/43577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:56:09,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-15 19:56:09,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-15 19:56:09,481 INFO [Listener at localhost/43577] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42249,1700078002491' ***** 2023-11-15 19:56:09,482 INFO [Listener at localhost/43577] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-15 19:56:09,482 INFO [RS:0;jenkins-hbase4:42249] regionserver.HeapMemoryManager(220): Stopping 2023-11-15 19:56:09,482 INFO [RS:0;jenkins-hbase4:42249] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-15 19:56:09,482 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-15 19:56:09,482 INFO [RS:0;jenkins-hbase4:42249] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-15 19:56:09,482 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 90ca860037191a24937594b3f2e23821 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 614c1adb45ce27804137200be2472981 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 7b31c220251c7cd4674568bbe1cee203 2023-11-15 19:56:09,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 90ca860037191a24937594b3f2e23821, disabling compactions & flushes 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for a1e2b054e120c42d1c3254e5bf778fca 2023-11-15 19:56:09,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 345bd17971f9f52467e4027968d08539 2023-11-15 19:56:09,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 1b18eb7fb184cf7b1796f0be6fae82a7 2023-11-15 19:56:09,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. after waiting 0 ms 2023-11-15 19:56:09,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 3e25eb704f1ec32bbf32935b51161078 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 622d6f4f194d5d320660fd1dcc1995da 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for adece068f30ad1573248e55d1a9945a5 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for aa6ea33808f58f330fd13440573a69ec 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for b338a0c4aca40823c5a393a0804e31ae 2023-11-15 19:56:09,483 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 9c23c324471d392504a9df8aaa65154b 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 65fdc9444c3e3ebe54107538d8fc3b04 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for a1b7e9aa0f9b5a0f41ded90bdb3eefba 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 663dfc0e063cc7d4ca1e0b1843d16ec8 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 1832f52a2a4870c6e6f331ad6393f6b3 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for e7de5c4100e506844c83d967f1832b74 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 19f0cc58719014d965ff84559b0ced63 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 4e3041c1c190ff3451901a9a27560aa5 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 5e9fedf55069b3b4497e68f08fb45546 2023-11-15 19:56:09,484 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:09,484 DEBUG [RS:0;jenkins-hbase4:42249] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x778b05eb to 127.0.0.1:50885 2023-11-15 19:56:09,484 DEBUG [RS:0;jenkins-hbase4:42249] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:56:09,485 INFO [RS:0;jenkins-hbase4:42249] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-15 19:56:09,485 INFO [RS:0;jenkins-hbase4:42249] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-15 19:56:09,485 INFO [RS:0;jenkins-hbase4:42249] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-15 19:56:09,485 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-15 19:56:09,485 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-15 19:56:09,485 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-15 19:56:09,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-15 19:56:09,485 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-15 19:56:09,485 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-15 19:56:09,485 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-15 19:56:09,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-15 19:56:09,486 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1504): Waiting on 1588230740, 1832f52a2a4870c6e6f331ad6393f6b3, 19f0cc58719014d965ff84559b0ced63, 1b18eb7fb184cf7b1796f0be6fae82a7, 345bd17971f9f52467e4027968d08539, 3e25eb704f1ec32bbf32935b51161078, 4e3041c1c190ff3451901a9a27560aa5, 5e9fedf55069b3b4497e68f08fb45546, 614c1adb45ce27804137200be2472981, 622d6f4f194d5d320660fd1dcc1995da, 65fdc9444c3e3ebe54107538d8fc3b04, 663dfc0e063cc7d4ca1e0b1843d16ec8, 7b31c220251c7cd4674568bbe1cee203, 90ca860037191a24937594b3f2e23821, 9c23c324471d392504a9df8aaa65154b, a1b7e9aa0f9b5a0f41ded90bdb3eefba, a1e2b054e120c42d1c3254e5bf778fca, aa6ea33808f58f330fd13440573a69ec, adece068f30ad1573248e55d1a9945a5, b338a0c4aca40823c5a393a0804e31ae, e7de5c4100e506844c83d967f1832b74 2023-11-15 19:56:09,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithMonthlyPolicy/90ca860037191a24937594b3f2e23821/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-15 19:56:09,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:56:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 90ca860037191a24937594b3f2e23821: 2023-11-15 19:56:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700078018677.90ca860037191a24937594b3f2e23821. 2023-11-15 19:56:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 614c1adb45ce27804137200be2472981, disabling compactions & flushes 2023-11-15 19:56:09,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:56:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:56:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. after waiting 0 ms 2023-11-15 19:56:09,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:56:09,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithMonthlyPolicy/614c1adb45ce27804137200be2472981/recovered.edits/51.seqid, newMaxSeqId=51, maxSeqId=1 2023-11-15 19:56:09,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:56:09,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 614c1adb45ce27804137200be2472981: 2023-11-15 19:56:09,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700078142887.614c1adb45ce27804137200be2472981. 2023-11-15 19:56:09,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b31c220251c7cd4674568bbe1cee203, disabling compactions & flushes 2023-11-15 19:56:09,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:09,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:09,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. after waiting 0 ms 2023-11-15 19:56:09,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:09,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/.tmp/info/aad6f7cafb2540dc8fb23e4ed34bfb7c 2023-11-15 19:56:09,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/7b31c220251c7cd4674568bbe1cee203/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-15 19:56:09,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b31c220251c7cd4674568bbe1cee203: 2023-11-15 19:56:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700078152060.7b31c220251c7cd4674568bbe1cee203. 2023-11-15 19:56:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1e2b054e120c42d1c3254e5bf778fca, disabling compactions & flushes 2023-11-15 19:56:09,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:56:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:56:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. after waiting 0 ms 2023-11-15 19:56:09,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:56:09,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a1e2b054e120c42d1c3254e5bf778fca 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-15 19:56:09,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aad6f7cafb2540dc8fb23e4ed34bfb7c 2023-11-15 19:56:09,516 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-15 19:56:09,572 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-15 19:56:09,686 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1504): Waiting on 1588230740, 1832f52a2a4870c6e6f331ad6393f6b3, 19f0cc58719014d965ff84559b0ced63, 1b18eb7fb184cf7b1796f0be6fae82a7, 345bd17971f9f52467e4027968d08539, 3e25eb704f1ec32bbf32935b51161078, 4e3041c1c190ff3451901a9a27560aa5, 5e9fedf55069b3b4497e68f08fb45546, 622d6f4f194d5d320660fd1dcc1995da, 65fdc9444c3e3ebe54107538d8fc3b04, 663dfc0e063cc7d4ca1e0b1843d16ec8, 9c23c324471d392504a9df8aaa65154b, a1b7e9aa0f9b5a0f41ded90bdb3eefba, a1e2b054e120c42d1c3254e5bf778fca, aa6ea33808f58f330fd13440573a69ec, adece068f30ad1573248e55d1a9945a5, b338a0c4aca40823c5a393a0804e31ae, e7de5c4100e506844c83d967f1832b74 2023-11-15 19:56:09,856 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-15 19:56:09,856 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-15 19:56:09,887 DEBUG [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1504): Waiting on 1588230740, 1832f52a2a4870c6e6f331ad6393f6b3, 19f0cc58719014d965ff84559b0ced63, 1b18eb7fb184cf7b1796f0be6fae82a7, 345bd17971f9f52467e4027968d08539, 3e25eb704f1ec32bbf32935b51161078, 4e3041c1c190ff3451901a9a27560aa5, 5e9fedf55069b3b4497e68f08fb45546, 622d6f4f194d5d320660fd1dcc1995da, 65fdc9444c3e3ebe54107538d8fc3b04, 663dfc0e063cc7d4ca1e0b1843d16ec8, 9c23c324471d392504a9df8aaa65154b, a1b7e9aa0f9b5a0f41ded90bdb3eefba, a1e2b054e120c42d1c3254e5bf778fca, aa6ea33808f58f330fd13440573a69ec, adece068f30ad1573248e55d1a9945a5, b338a0c4aca40823c5a393a0804e31ae, e7de5c4100e506844c83d967f1832b74 2023-11-15 19:56:09,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/.tmp/rep_barrier/80c6fc955064408897b4cab7fce078f3 2023-11-15 19:56:09,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/.tmp/info/75cc8a2d473349cb9233f12f3b2644a7 2023-11-15 19:56:09,913 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80c6fc955064408897b4cab7fce078f3 2023-11-15 19:56:09,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/.tmp/info/75cc8a2d473349cb9233f12f3b2644a7 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/info/75cc8a2d473349cb9233f12f3b2644a7 2023-11-15 19:56:09,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/.tmp/table/c1975e0845a040feadaedae6ea83b3cf 2023-11-15 19:56:09,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/info/75cc8a2d473349cb9233f12f3b2644a7, entries=3, sequenceid=7, filesize=4.8 K 2023-11-15 19:56:09,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for a1e2b054e120c42d1c3254e5bf778fca in 427ms, sequenceid=7, compaction requested=false 2023-11-15 19:56:09,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1975e0845a040feadaedae6ea83b3cf 2023-11-15 19:56:09,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/namespace/a1e2b054e120c42d1c3254e5bf778fca/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-15 19:56:09,933 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/.tmp/info/aad6f7cafb2540dc8fb23e4ed34bfb7c as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/info/aad6f7cafb2540dc8fb23e4ed34bfb7c 2023-11-15 19:56:09,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:56:09,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1e2b054e120c42d1c3254e5bf778fca: 2023-11-15 19:56:09,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700078005178.a1e2b054e120c42d1c3254e5bf778fca. 2023-11-15 19:56:09,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 345bd17971f9f52467e4027968d08539, disabling compactions & flushes 2023-11-15 19:56:09,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:56:09,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:56:09,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. after waiting 0 ms 2023-11-15 19:56:09,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:56:09,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/345bd17971f9f52467e4027968d08539/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-15 19:56:09,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aad6f7cafb2540dc8fb23e4ed34bfb7c 2023-11-15 19:56:09,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/info/aad6f7cafb2540dc8fb23e4ed34bfb7c, entries=226, sequenceid=130, filesize=37.9 K 2023-11-15 19:56:09,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:56:09,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 345bd17971f9f52467e4027968d08539: 2023-11-15 19:56:09,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700078043664.345bd17971f9f52467e4027968d08539. 2023-11-15 19:56:09,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b18eb7fb184cf7b1796f0be6fae82a7, disabling compactions & flushes 2023-11-15 19:56:09,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:56:09,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:56:09,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. after waiting 0 ms 2023-11-15 19:56:09,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:56:09,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/.tmp/rep_barrier/80c6fc955064408897b4cab7fce078f3 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/rep_barrier/80c6fc955064408897b4cab7fce078f3 2023-11-15 19:56:09,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/1b18eb7fb184cf7b1796f0be6fae82a7/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-15 19:56:09,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:56:09,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b18eb7fb184cf7b1796f0be6fae82a7: 2023-11-15 19:56:09,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700078061989.1b18eb7fb184cf7b1796f0be6fae82a7. 2023-11-15 19:56:09,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3e25eb704f1ec32bbf32935b51161078, disabling compactions & flushes 2023-11-15 19:56:09,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:56:09,942 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80c6fc955064408897b4cab7fce078f3 2023-11-15 19:56:09,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:56:09,942 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/rep_barrier/80c6fc955064408897b4cab7fce078f3, entries=1, sequenceid=130, filesize=5.0 K 2023-11-15 19:56:09,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. after waiting 0 ms 2023-11-15 19:56:09,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:56:09,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/.tmp/table/c1975e0845a040feadaedae6ea83b3cf as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/table/c1975e0845a040feadaedae6ea83b3cf 2023-11-15 19:56:09,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/3e25eb704f1ec32bbf32935b51161078/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-15 19:56:09,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:56:09,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3e25eb704f1ec32bbf32935b51161078: 2023-11-15 19:56:09,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700078125744.3e25eb704f1ec32bbf32935b51161078. 2023-11-15 19:56:09,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 622d6f4f194d5d320660fd1dcc1995da, disabling compactions & flushes 2023-11-15 19:56:09,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:56:09,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:56:09,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. after waiting 0 ms 2023-11-15 19:56:09,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:56:09,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1975e0845a040feadaedae6ea83b3cf 2023-11-15 19:56:09,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/table/c1975e0845a040feadaedae6ea83b3cf, entries=27, sequenceid=130, filesize=6.6 K 2023-11-15 19:56:09,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 464ms, sequenceid=130, compaction requested=false 2023-11-15 19:56:09,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/622d6f4f194d5d320660fd1dcc1995da/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-15 19:56:09,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:56:09,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 622d6f4f194d5d320660fd1dcc1995da: 2023-11-15 19:56:09,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700078101127.622d6f4f194d5d320660fd1dcc1995da. 2023-11-15 19:56:09,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing adece068f30ad1573248e55d1a9945a5, disabling compactions & flushes 2023-11-15 19:56:09,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:56:09,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:56:09,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. after waiting 0 ms 2023-11-15 19:56:09,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:56:09,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-15 19:56:09,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-15 19:56:09,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-15 19:56:09,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-15 19:56:09,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-15 19:56:09,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/adece068f30ad1573248e55d1a9945a5/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-15 19:56:09,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:56:09,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for adece068f30ad1573248e55d1a9945a5: 2023-11-15 19:56:09,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700078125744.adece068f30ad1573248e55d1a9945a5. 2023-11-15 19:56:09,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa6ea33808f58f330fd13440573a69ec, disabling compactions & flushes 2023-11-15 19:56:09,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:56:09,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:56:09,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. after waiting 0 ms 2023-11-15 19:56:09,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:56:09,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/aa6ea33808f58f330fd13440573a69ec/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-15 19:56:09,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:56:09,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa6ea33808f58f330fd13440573a69ec: 2023-11-15 19:56:09,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700078079020.aa6ea33808f58f330fd13440573a69ec. 2023-11-15 19:56:09,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b338a0c4aca40823c5a393a0804e31ae, disabling compactions & flushes 2023-11-15 19:56:09,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:56:09,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:56:09,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. after waiting 0 ms 2023-11-15 19:56:09,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:56:09,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/b338a0c4aca40823c5a393a0804e31ae/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-15 19:56:09,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:56:09,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b338a0c4aca40823c5a393a0804e31ae: 2023-11-15 19:56:09,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700078043664.b338a0c4aca40823c5a393a0804e31ae. 2023-11-15 19:56:09,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c23c324471d392504a9df8aaa65154b, disabling compactions & flushes 2023-11-15 19:56:09,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:56:09,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:56:09,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. after waiting 0 ms 2023-11-15 19:56:09,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:56:09,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMinorCompactionWithWeeklyPolicy/9c23c324471d392504a9df8aaa65154b/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-15 19:56:09,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:56:09,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c23c324471d392504a9df8aaa65154b: 2023-11-15 19:56:09,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700078031717.9c23c324471d392504a9df8aaa65154b. 2023-11-15 19:56:09,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 65fdc9444c3e3ebe54107538d8fc3b04, disabling compactions & flushes 2023-11-15 19:56:09,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:56:09,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:56:09,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. after waiting 0 ms 2023-11-15 19:56:09,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:56:09,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/65fdc9444c3e3ebe54107538d8fc3b04/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-15 19:56:09,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:56:09,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 65fdc9444c3e3ebe54107538d8fc3b04: 2023-11-15 19:56:09,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700078101127.65fdc9444c3e3ebe54107538d8fc3b04. 2023-11-15 19:56:09,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1b7e9aa0f9b5a0f41ded90bdb3eefba, disabling compactions & flushes 2023-11-15 19:56:09,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:09,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:09,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. after waiting 0 ms 2023-11-15 19:56:09,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:09,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/a1b7e9aa0f9b5a0f41ded90bdb3eefba/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-15 19:56:09,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:09,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1b7e9aa0f9b5a0f41ded90bdb3eefba: 2023-11-15 19:56:09,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700078152060.a1b7e9aa0f9b5a0f41ded90bdb3eefba. 2023-11-15 19:56:09,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 663dfc0e063cc7d4ca1e0b1843d16ec8, disabling compactions & flushes 2023-11-15 19:56:09,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:56:09,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:56:09,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. after waiting 0 ms 2023-11-15 19:56:09,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:56:09,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testCompactionWithHFileLink/663dfc0e063cc7d4ca1e0b1843d16ec8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-15 19:56:09,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:56:09,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 663dfc0e063cc7d4ca1e0b1843d16ec8: 2023-11-15 19:56:09,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700078101127.663dfc0e063cc7d4ca1e0b1843d16ec8. 2023-11-15 19:56:09,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1832f52a2a4870c6e6f331ad6393f6b3, disabling compactions & flushes 2023-11-15 19:56:09,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:09,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:09,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. after waiting 0 ms 2023-11-15 19:56:09,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:09,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionFromAdmin/1832f52a2a4870c6e6f331ad6393f6b3/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-15 19:56:09,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:09,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1832f52a2a4870c6e6f331ad6393f6b3: 2023-11-15 19:56:09,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700078152060.1832f52a2a4870c6e6f331ad6393f6b3. 2023-11-15 19:56:09,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7de5c4100e506844c83d967f1832b74, disabling compactions & flushes 2023-11-15 19:56:09,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:56:09,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:56:09,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. after waiting 0 ms 2023-11-15 19:56:09,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:56:09,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e7de5c4100e506844c83d967f1832b74/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-15 19:56:09,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:56:09,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7de5c4100e506844c83d967f1832b74: 2023-11-15 19:56:09,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700078006363.e7de5c4100e506844c83d967f1832b74. 2023-11-15 19:56:09,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19f0cc58719014d965ff84559b0ced63, disabling compactions & flushes 2023-11-15 19:56:09,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:56:09,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:56:09,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. after waiting 0 ms 2023-11-15 19:56:09,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:56:09,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testScannerOnBulkLoadRefHFiles/19f0cc58719014d965ff84559b0ced63/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-15 19:56:09,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:56:09,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19f0cc58719014d965ff84559b0ced63: 2023-11-15 19:56:09,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700078043664.19f0cc58719014d965ff84559b0ced63. 2023-11-15 19:56:09,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e3041c1c190ff3451901a9a27560aa5, disabling compactions & flushes 2023-11-15 19:56:09,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:56:09,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:56:09,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. after waiting 0 ms 2023-11-15 19:56:09,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:56:09,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/default/testMajorCompactionWithWeeklyPolicy/4e3041c1c190ff3451901a9a27560aa5/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-15 19:56:09,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:56:09,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e3041c1c190ff3451901a9a27560aa5: 2023-11-15 19:56:09,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700078048706.4e3041c1c190ff3451901a9a27560aa5. 2023-11-15 19:56:09,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e9fedf55069b3b4497e68f08fb45546, disabling compactions & flushes 2023-11-15 19:56:09,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:56:09,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:56:09,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. after waiting 0 ms 2023-11-15 19:56:09,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:56:09,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/data/ns/testMinorCompaction/5e9fedf55069b3b4497e68f08fb45546/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-15 19:56:09,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:56:09,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e9fedf55069b3b4497e68f08fb45546: 2023-11-15 19:56:09,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700078125744.5e9fedf55069b3b4497e68f08fb45546. 2023-11-15 19:56:10,087 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42249,1700078002491; all regions closed. 2023-11-15 19:56:10,095 DEBUG [RS:0;jenkins-hbase4:42249] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/oldWALs 2023-11-15 19:56:10,095 INFO [RS:0;jenkins-hbase4:42249] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42249%2C1700078002491.meta:.meta(num 1700078004913) 2023-11-15 19:56:10,098 DEBUG [RS:0;jenkins-hbase4:42249] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/oldWALs 2023-11-15 19:56:10,098 INFO [RS:0;jenkins-hbase4:42249] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42249%2C1700078002491:(num 1700078003996) 2023-11-15 19:56:10,098 DEBUG [RS:0;jenkins-hbase4:42249] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:56:10,099 INFO [RS:0;jenkins-hbase4:42249] regionserver.LeaseManager(133): Closed leases 2023-11-15 19:56:10,099 INFO [RS:0;jenkins-hbase4:42249] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-15 19:56:10,099 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-15 19:56:10,100 INFO [RS:0;jenkins-hbase4:42249] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42249 2023-11-15 19:56:10,112 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-15 19:56:10,112 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42249,1700078002491 2023-11-15 19:56:10,112 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-15 19:56:10,113 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42249,1700078002491] 2023-11-15 19:56:10,114 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42249,1700078002491; numProcessing=1 2023-11-15 19:56:10,115 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42249,1700078002491 already deleted, retry=false 2023-11-15 19:56:10,115 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,42249,1700078002491 expired; onlineServers=0 2023-11-15 19:56:10,115 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38755,1700078001267' ***** 2023-11-15 19:56:10,115 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-15 19:56:10,116 DEBUG [M:0;jenkins-hbase4:38755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@275d8636, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-15 19:56:10,116 INFO [M:0;jenkins-hbase4:38755] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38755,1700078001267 2023-11-15 19:56:10,116 INFO [M:0;jenkins-hbase4:38755] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38755,1700078001267; all regions closed. 2023-11-15 19:56:10,116 DEBUG [M:0;jenkins-hbase4:38755] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-15 19:56:10,116 DEBUG [M:0;jenkins-hbase4:38755] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-15 19:56:10,116 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-15 19:56:10,116 DEBUG [M:0;jenkins-hbase4:38755] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-15 19:56:10,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700078003631] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700078003631,5,FailOnTimeoutGroup] 2023-11-15 19:56:10,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700078003631] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700078003631,5,FailOnTimeoutGroup] 2023-11-15 19:56:10,116 INFO [M:0;jenkins-hbase4:38755] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-15 19:56:10,116 INFO [M:0;jenkins-hbase4:38755] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-15 19:56:10,116 INFO [M:0;jenkins-hbase4:38755] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-15 19:56:10,117 DEBUG [M:0;jenkins-hbase4:38755] master.HMaster(1512): Stopping service threads 2023-11-15 19:56:10,117 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-15 19:56:10,117 INFO [M:0;jenkins-hbase4:38755] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-15 19:56:10,117 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-15 19:56:10,117 ERROR [M:0;jenkins-hbase4:38755] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-15 19:56:10,118 INFO [M:0;jenkins-hbase4:38755] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-15 19:56:10,118 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-15 19:56:10,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-15 19:56:10,118 DEBUG [M:0;jenkins-hbase4:38755] zookeeper.ZKUtil(398): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-15 19:56:10,118 WARN [M:0;jenkins-hbase4:38755] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-15 19:56:10,118 INFO [M:0;jenkins-hbase4:38755] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-15 19:56:10,118 INFO [M:0;jenkins-hbase4:38755] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-15 19:56:10,119 DEBUG [M:0;jenkins-hbase4:38755] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-15 19:56:10,119 INFO [M:0;jenkins-hbase4:38755] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:56:10,119 DEBUG [M:0;jenkins-hbase4:38755] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:56:10,119 DEBUG [M:0;jenkins-hbase4:38755] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-15 19:56:10,119 DEBUG [M:0;jenkins-hbase4:38755] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:56:10,119 INFO [M:0;jenkins-hbase4:38755] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.95 KB heapSize=599.09 KB 2023-11-15 19:56:10,214 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-15 19:56:10,214 INFO [RS:0;jenkins-hbase4:42249] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42249,1700078002491; zookeeper connection closed. 2023-11-15 19:56:10,214 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): regionserver:42249-0x101eb4ad0a90001, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-15 19:56:10,214 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4c779e04] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4c779e04 2023-11-15 19:56:10,214 INFO [Listener at localhost/43577] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-15 19:56:10,527 INFO [M:0;jenkins-hbase4:38755] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.95 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/72e5089ab3304feb85f5044176c8ea36 2023-11-15 19:56:10,531 INFO [M:0;jenkins-hbase4:38755] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72e5089ab3304feb85f5044176c8ea36 2023-11-15 19:56:10,531 DEBUG [M:0;jenkins-hbase4:38755] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/72e5089ab3304feb85f5044176c8ea36 as hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/72e5089ab3304feb85f5044176c8ea36 2023-11-15 19:56:10,535 INFO [M:0;jenkins-hbase4:38755] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72e5089ab3304feb85f5044176c8ea36 2023-11-15 19:56:10,535 INFO [M:0;jenkins-hbase4:38755] regionserver.HStore(1080): Added hdfs://localhost:37975/user/jenkins/test-data/54b48ec3-b613-2877-34c3-8d66875b5552/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/72e5089ab3304feb85f5044176c8ea36, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-15 19:56:10,536 INFO [M:0;jenkins-hbase4:38755] regionserver.HRegion(2948): Finished flush of dataSize ~512.95 KB/525258, heapSize ~599.08 KB/613456, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1011, compaction requested=false 2023-11-15 19:56:10,536 INFO [M:0;jenkins-hbase4:38755] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-15 19:56:10,536 DEBUG [M:0;jenkins-hbase4:38755] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-15 19:56:10,539 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-15 19:56:10,539 INFO [M:0;jenkins-hbase4:38755] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-15 19:56:10,540 INFO [M:0;jenkins-hbase4:38755] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38755 2023-11-15 19:56:10,542 DEBUG [M:0;jenkins-hbase4:38755] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38755,1700078001267 already deleted, retry=false 2023-11-15 19:56:10,644 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-15 19:56:10,644 DEBUG [Listener at localhost/43577-EventThread] zookeeper.ZKWatcher(600): master:38755-0x101eb4ad0a90000, quorum=127.0.0.1:50885, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-15 19:56:10,644 INFO [M:0;jenkins-hbase4:38755] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38755,1700078001267; zookeeper connection closed. 2023-11-15 19:56:10,646 WARN [Listener at localhost/43577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-15 19:56:10,650 INFO [Listener at localhost/43577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-15 19:56:10,756 WARN [BP-107386809-172.31.14.131-1700077997855 heartbeating to localhost/127.0.0.1:37975] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-15 19:56:10,756 WARN [BP-107386809-172.31.14.131-1700077997855 heartbeating to localhost/127.0.0.1:37975] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-107386809-172.31.14.131-1700077997855 (Datanode Uuid 8ca454cd-60e8-41a1-b415-f9c0c45a98ca) service to localhost/127.0.0.1:37975 2023-11-15 19:56:10,758 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/cluster_60a5767f-3161-dba1-1f98-fab1c37be2d9/dfs/data/data1/current/BP-107386809-172.31.14.131-1700077997855] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-15 19:56:10,758 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/08cf90a5-8b90-bf49-73a1-3f523a19d0c1/cluster_60a5767f-3161-dba1-1f98-fab1c37be2d9/dfs/data/data2/current/BP-107386809-172.31.14.131-1700077997855] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-15 19:56:10,783 INFO [Listener at localhost/43577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-15 19:56:10,920 INFO [Listener at localhost/43577] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-15 19:56:11,007 INFO [Listener at localhost/43577] hbase.HBaseTestingUtility(1293): Minicluster is down